Jul 21 01:34:14.204347 ip-10-0-138-80 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 01:34:14.204528 ip-10-0-138-80 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 01:34:14.204582 ip-10-0-138-80 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 01:34:14.204835 ip-10-0-138-80 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 01:34:24.261855 ip-10-0-138-80 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 01:34:24.261874 ip-10-0-138-80 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ba930c2892a64c6a844277f2cd79e00b --
Jul 21 01:36:21.285834 ip-10-0-138-80 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 01:36:23.454592 ip-10-0-138-80 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:36:23.454592 ip-10-0-138-80 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 01:36:23.454592 ip-10-0-138-80 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:36:23.454592 ip-10-0-138-80 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 01:36:23.454592 ip-10-0-138-80 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 01:36:23.456926 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.456810    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 01:36:23.461432 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461406    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:36:23.461432 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461431    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:36:23.461432 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461435    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:36:23.461432 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461439    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:36:23.461432 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461442    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461445    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461448    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461450    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461453    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461455    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461458    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461461    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461464    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461467    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461475    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461478    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461480    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461483    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461487    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461489    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461492    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461494    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461497    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461499    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:36:23.461568 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461502    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461505    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461509    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461512    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461515    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461518    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461521    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461523    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461526    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461528    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461531    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461533    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461536    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461539    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461542    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461545    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461548    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461550    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461553    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461556    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:36:23.462070 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461558    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461562    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461565    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461569    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461572    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461575    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461578    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461581    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461584    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461587    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461589    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461592    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461595    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461597    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461600    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461602    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461605    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461607    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461610    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:36:23.462588 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461612    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461615    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461617    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461620    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461622    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461625    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461627    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461632    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461635    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461638    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461640    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461644    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461648    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461650    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461652    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461655    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461657    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461660    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461662    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:36:23.463040 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461665    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461668    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461673    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461676    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461678    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461681    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461684    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461686    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461689    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461692    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461694    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461697    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461699    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461702    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461705    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461707    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.461710    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462412    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462419    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462422    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:36:23.463534 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462425    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462428    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462431    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462436    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462440    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462443    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462446    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462448    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462451    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462454    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462456    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462459    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462461    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462464    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462466    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462469    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462471    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462474    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462476    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:36:23.464000 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462479    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462481    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462484    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462487    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462490    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462492    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462494    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462497    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462499    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462502    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462504    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462507    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462509    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462513    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462516    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462519    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462522    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462524    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462527    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462530    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:36:23.464505 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462532    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462535    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462537    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462539    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462542    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462544    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462547    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462549    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462552    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462554    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462557    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462559    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462562    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462565    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462567    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462570    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462572    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462575    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462577    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462580    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:36:23.464974 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462582    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462585    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462587    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462590    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462592    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462596    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462599    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462602    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462604    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462607    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462610    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462612    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462615    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462617    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462620    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462622    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462625    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462628    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462631    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462633    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:36:23.465468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462637    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462640    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462642    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462645    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462647    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462650    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462653    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462655    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462658    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462662    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462665    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462668    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462671    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462674    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462678    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462682    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.462685    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463068    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463073    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:36:23.465958 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463078    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463082    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463088    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463091    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463094    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463097    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463100    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463103    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463106    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463109    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463112    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463115    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463118    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463120    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463123    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463126    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463128    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463131    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463133    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:36:23.466437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463138    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463141    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463144    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463147    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463150    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463152    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463155    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463158    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463160    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463164    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463168    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463171    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463173    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463176    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463178    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463181    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463184    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463186    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463189    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463191    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:36:23.466890 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463194    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463196    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463199    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463201    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463204    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463206    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463210    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463212    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463215    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463217    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463220    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463222    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463225    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463227    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463230    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463233    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463236    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463239    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463241    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:36:23.467374 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463243    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463246    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463248    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463251    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463253    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463256    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463258    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463261    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463263    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463265    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463271    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463273    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463276    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463279    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463281    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463284    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463286    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463288    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463291    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463294    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:36:23.467830 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463296    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463299    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463301    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463320    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463323    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463325    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463328    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463331    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463334    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463337    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463339    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463342    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463344    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463347    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463350    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463352    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463355    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463357    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.463360    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463422    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463428    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 01:36:23.468298 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463434    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463480    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463488    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463492    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463497    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463502    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463505    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463508    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463512    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463515    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463519    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463522    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463524    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463528    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463531    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463534    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463539    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463542    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463546    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463549    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463552    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463556    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463560    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 01:36:23.468815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463563    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463566    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463569    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463573    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463575    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463579    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463582    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463586    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463590    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463593    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463596    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463600    2568 flags.go:64] FLAG: --enable-server="true"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463603    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463608    2568 flags.go:64] FLAG: --event-burst="100"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463611    2568 flags.go:64] FLAG: --event-qps="50"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463614    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463617    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463620    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463624    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463627    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463630    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463633    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463636    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463639    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463642    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 01:36:23.469372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463645    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463648    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463650    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463653    2568 flags.go:64] FLAG: --feature-gates=""
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463657    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463660    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463663    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463666    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463669    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463672    2568 flags.go:64] FLAG: --help="false"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463675    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463678    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463681    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463684    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463688    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463692    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463695    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463698    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463701    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463705    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463708    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463711    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463714    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463717    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 01:36:23.470025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463719    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463722    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463725    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463728    2568 flags.go:64] FLAG: --lock-file=""
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463731    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463733    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463736    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463742    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463745    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463747    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463750    2568 flags.go:64] FLAG: --logging-format="text"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463754    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463757    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463760    2568 flags.go:64] FLAG: --manifest-url=""
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463763    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463767    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463770    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463774    2568 flags.go:64] FLAG: --max-pods="110"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463777    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463780    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463783    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463786    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463792    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463795    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463798    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 01:36:23.470619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463804    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463807    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463810    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463814    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463817    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463822    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463825    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463828    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463831    2568 flags.go:64] FLAG: --port="10250"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463835    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463837    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03603bb3aaf7dc1a7"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463840    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463843    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463846    2568 flags.go:64] FLAG: --register-node="true"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463849    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463852    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463855    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463858    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463861    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463864    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463867    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463870    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463873    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463876    2568 flags.go:64] FLAG: --runonce="false"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463879    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 01:36:23.471228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463882    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463885    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463888    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463891    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463896    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463899    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463902    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463905    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463908    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463911    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463914    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463917    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463920    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463923    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463930    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463933    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463936    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463940    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463943    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463946    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463949    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463952    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463954    2568 flags.go:64] FLAG: --v="2"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463958    2568 flags.go:64] FLAG: --version="false"
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463962    2568 flags.go:64] FLAG: --vmodule=""
Jul 21 01:36:23.471843 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463966    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.463969    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464088    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464094    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464097    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464100    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464103    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464106    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464110    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464113    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464116    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464123    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464125    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464128    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464131    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464133    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464136    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464139    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464141    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464145    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:36:23.472462 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464147    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464150    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464152    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464155    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464158    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464160    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464163    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464165    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464168    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464171    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464173    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464176    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464178    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464181    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464183    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464186    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464190    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464192    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464195    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464197    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:36:23.472952 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464200    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464203    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464205    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464213    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464216    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464220    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464224    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464227    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464230    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464233    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464236    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464239    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464242    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464244    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464247    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464249    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464252    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464256    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464259    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:36:23.473470 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464262    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464264    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464267    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464270    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464273    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464275    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464278    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464280    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464283    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464285    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464288    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464290    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464293    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464295    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464298    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464300    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464322    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464327    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464331    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464335    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:36:23.473921 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464338    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464343    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464346    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464349    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464352    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464354    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464358    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464361    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464363    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464366    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464368    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464371    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464373    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464376    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464379    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464382    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464384    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464387    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464389    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464392    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:36:23.474425 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464394    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.464397    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.464406    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.470966    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.470979    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.470998    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.471004    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471057    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471061    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471064    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471067    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471069    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471072    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471074    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471077    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:36:23.474922 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471079    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471082    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471084    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471087    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471089    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471092    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471094    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471097    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471099    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471102    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471104    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471106    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471109    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471111    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471114    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471116    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471119    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471122    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471124    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471127    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:36:23.475279 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471131    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471136    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471139    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471142    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471145    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471148    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471151    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471153    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471156    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471159    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471161    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471164    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471166    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471168    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471171    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471173    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471176    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471178    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471181    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471184    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:36:23.475790 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471187    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471189    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471192    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471194    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471197    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471199    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471202    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471204    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471207    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471209    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471212    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471214    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471217    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471220    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471222    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471225    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471228    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471231    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471233    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471236    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:36:23.476256 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471239    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471242    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471244    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471247    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471249    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471252    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471255    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471257    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471260    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471262    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471265    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471267    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471270    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471272    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471275    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471277    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471279    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471282    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471284    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471287    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:36:23.476745 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471289    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471293    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471297    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471300    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471302    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471321    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471324    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471327    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471331    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471333    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471337    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.471342    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471457    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471462    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 01:36:23.477224 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471465    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471468    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471471    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471474    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471476    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471479    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471481    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471484    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471487    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471489    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471491    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471494    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471497    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471499    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471502    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471505    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471507    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471510    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471513    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471515    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 01:36:23.477578 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471517    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471520    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471522    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471525    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471528    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471530    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471533    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471536    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471539    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471541    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471543    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471546    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471549    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471551    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471554    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471557    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471559    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471562    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471564    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 01:36:23.478077 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471566    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471569    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471571    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471574    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471576    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471579    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471581    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471584    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471586    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471588    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471591    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471593    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471596    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471598    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471600    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471603    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471606    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471608    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471610    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471613    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 01:36:23.478533 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471616    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471619    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471621    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471624    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471626    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471629    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471631    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471635    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471638    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471641    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471643    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471647    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471651    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471654    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471656    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471659    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471662    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471664    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471667    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 01:36:23.479022 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471670    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471673    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471676    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471678    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471680    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471683    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471686    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471688    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471691    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471693    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471696    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471699    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471702    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471705    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471707    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471710    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471713    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471715    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 01:36:23.479575 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:23.471718    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 01:36:23.480012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.471723    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 01:36:23.480012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.471832    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 01:36:23.480012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.475385    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 01:36:23.480012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.476916    2568 server.go:1019] "Starting client certificate rotation"
Jul 21 01:36:23.480012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.477011    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 01:36:23.480012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.477048    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 01:36:23.480012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.479443    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 01:36:23.485546 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.485523    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 01:36:23.505321 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.505288    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 21 01:36:23.507150 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.507134    2568 log.go:25] "Validated CRI v1 image API"
Jul 21 01:36:23.510038 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.510021    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 01:36:23.512921 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.512902    2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a68032d4-3cd6-4017-91ac-b79947917c89:/dev/nvme0n1p4 ddeba6d5-58f7-4364-888d-26b2239f91e8:/dev/nvme0n1p3]
Jul 21 01:36:23.513002 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.512921    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 01:36:23.517818 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.517718    2568 manager.go:216] Machine: {Timestamp:2026-07-21 01:36:23.516596536 +0000 UTC m=+0.361590122 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3132613 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bee73cc29b050f33ca283a8fc4834 SystemUUID:ec2bee73-cc29-b050-f33c-a283a8fc4834 BootID:ba930c28-92a6-4c6a-8442-77f2cd79e00b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:bc:78:f1:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:bc:78:f1:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:3e:14:9a:84:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 01:36:23.517818 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.517812    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 01:36:23.517931 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.517889    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 01:36:23.519039 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.519018    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 01:36:23.519179 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.519043    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 01:36:23.519746 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.519736    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 01:36:23.519785 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.519748    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 01:36:23.519785 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.519755    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 01:36:23.519963 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.519948    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 01:36:23.520483 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.520470    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 01:36:23.522117 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.522105    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 01:36:23.525125 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525114    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 01:36:23.525247 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525237    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 01:36:23.525285 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525276    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 01:36:23.525337 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525303    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 01:36:23.525337 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525331    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 01:36:23.525393 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525347    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 21 01:36:23.525393 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525359    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 01:36:23.525757 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525746    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 01:36:23.525801 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.525764    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 01:36:23.527921 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.527877    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 01:36:23.529691 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.529678    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 01:36:23.529732 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.529709    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 01:36:23.531177 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531165    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 01:36:23.531210 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531184    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 01:36:23.531210 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531190    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 01:36:23.531210 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531196    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 01:36:23.531289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531222    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 01:36:23.531289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531231    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 01:36:23.531289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531239    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 01:36:23.531289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531245    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 01:36:23.531289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531251    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 01:36:23.531289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531256    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 01:36:23.531289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531269    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 01:36:23.531289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.531274    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 01:36:23.532715 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.532705    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 01:36:23.532715 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.532715    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 01:36:23.534131 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.534109    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 01:36:23.534434 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.534115    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 01:36:23.536619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.536601    2568 server.go:1268] "Started kubelet"
Jul 21 01:36:23.536720 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.536667    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 01:36:23.536801 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.536754    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 01:36:23.536863 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.536824    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 01:36:23.537512 ip-10-0-138-80 systemd[1]: Started Kubernetes Kubelet.
Jul 21 01:36:23.537896 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.537881    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 01:36:23.538646 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.538627    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 01:36:23.542073 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.542053    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 01:36:23.543062 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.542105    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18c42a3a9aa59630  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-07-21 01:36:23.536571952 +0000 UTC m=+0.381565537,LastTimestamp:2026-07-21 01:36:23.536571952 +0000 UTC m=+0.381565537,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}"
Jul 21 01:36:23.543171 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.543128    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 01:36:23.544507 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.544494    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 01:36:23.544575 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.544510    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 01:36:23.544575 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.544559    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:23.544949 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.544935    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 01:36:23.545021 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.544943    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 01:36:23.545021 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545011    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 01:36:23.545121 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545106    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 01:36:23.545121 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545121    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 01:36:23.545370 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545355    2568 factory.go:55] Registering systemd factory
Jul 21 01:36:23.545441 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545373    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 21 01:36:23.545590 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545578    2568 factory.go:153] Registering CRI-O factory
Jul 21 01:36:23.545631 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545593    2568 factory.go:223] Registration of the crio container factory successfully
Jul 21 01:36:23.545674 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545643    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 01:36:23.545674 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545667    2568 factory.go:103] Registering Raw factory
Jul 21 01:36:23.545780 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.545694    2568 manager.go:1196] Started watching for new ooms in manager
Jul 21 01:36:23.546179 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.546166    2568 manager.go:349] Starting recovery of all containers
Jul 21 01:36:23.548851 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.548824    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 01:36:23.548935 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.548889    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 01:36:23.557805 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.556970    2568 manager.go:354] Recovery completed
Jul 21 01:36:23.559498 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.559479    2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 21 01:36:23.562325 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.562299    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:36:23.564176 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.564065    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:36:23.564237 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.564191    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:36:23.564237 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.564201    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:36:23.564683 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.564672    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 01:36:23.564723 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.564681    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:36:23.564723 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.564683    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 01:36:23.564792 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.564746    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 01:36:23.565343 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.565328    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:36:23.565420 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.565357    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:36:23.565420 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.565372    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:36:23.566089 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.566075    2568 policy_none.go:49] "None policy: Start"
Jul 21 01:36:23.566133 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.566092    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 01:36:23.566133 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.566103    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 01:36:23.566481 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.566422    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18c42a3a9c4aca10  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-80.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-07-21 01:36:23.564175888 +0000 UTC m=+0.409169478,LastTimestamp:2026-07-21 01:36:23.564175888 +0000 UTC m=+0.409169478,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}"
Jul 21 01:36:23.567214 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.567203    2568 policy_none.go:47] "Start"
Jul 21 01:36:23.574975 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.574918    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18c42a3a9c4b1a34  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-80.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-07-21 01:36:23.564196404 +0000 UTC m=+0.409189989,LastTimestamp:2026-07-21 01:36:23.564196404 +0000 UTC m=+0.409189989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}"
Jul 21 01:36:23.583647 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.583584    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18c42a3a9c4b3d55  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-80.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-07-21 01:36:23.564205397 +0000 UTC m=+0.409198983,LastTimestamp:2026-07-21 01:36:23.564205397 +0000 UTC m=+0.409198983,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}"
Jul 21 01:36:23.593806 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.593750    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-80.ec2.internal.18c42a3a9c4aca10\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18c42a3a9c4aca10  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-80.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-07-21 01:36:23.564175888 +0000 UTC m=+0.409169478,LastTimestamp:2026-07-21 01:36:23.565341417 +0000 UTC m=+0.410335008,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}"
Jul 21 01:36:23.601771 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.601719    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-80.ec2.internal.18c42a3a9c4b1a34\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18c42a3a9c4b1a34  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-80.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-07-21 01:36:23.564196404 +0000 UTC m=+0.409189989,LastTimestamp:2026-07-21 01:36:23.56536412 +0000 UTC m=+0.410357710,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}"
Jul 21 01:36:23.603879 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.603864    2568 manager.go:337] "Starting Device Plugin manager"
Jul 21 01:36:23.603952 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.603902    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 01:36:23.603952 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.603914    2568 server.go:87] "Starting device plugin registration server"
Jul 21 01:36:23.604179 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.604161    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 01:36:23.604262 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.604184    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 01:36:23.604350 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.604258    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 01:36:23.604350 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.604343    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 01:36:23.604350 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.604352    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 01:36:23.604827 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.604807    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 01:36:23.604885 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.604859    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:23.609553 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.609496    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-80.ec2.internal.18c42a3a9c4b3d55\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18c42a3a9c4b3d55  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-80.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-07-21 01:36:23.564205397 +0000 UTC m=+0.409198983,LastTimestamp:2026-07-21 01:36:23.565377326 +0000 UTC m=+0.410370915,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}"
Jul 21 01:36:23.619031 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.618977    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18c42a3a9ecb855f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-07-21 01:36:23.606166879 +0000 UTC m=+0.451160452,LastTimestamp:2026-07-21 01:36:23.606166879 +0000 UTC m=+0.451160452,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}"
Jul 21 01:36:23.640185 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.640165    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4rpf"
Jul 21 01:36:23.654018 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.647547    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4rpf"
Jul 21 01:36:23.704965 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.704944    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:36:23.705708 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.705694    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:36:23.705793 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.705725    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:36:23.705793 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.705740    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:36:23.705793 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.705773    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.718845 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.718817    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 01:36:23.720026 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.720007    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 01:36:23.720105 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.720039    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 01:36:23.720105 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.720057    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 01:36:23.720105 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.720101    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 01:36:23.720611 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.720593    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.720686 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.720623    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-80.ec2.internal\": node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:23.722216 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.722201    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:36:23.763359 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.763335    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:23.821165 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.821094    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal"]
Jul 21 01:36:23.821165 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.821160    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:36:23.822147 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.822130    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:36:23.822212 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.822161    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:36:23.822212 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.822172    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:36:23.823380 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.823368    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:36:23.823508 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.823493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.823549 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.823522    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:36:23.824104 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.824090    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:36:23.824151 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.824094    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:36:23.824151 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.824131    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:36:23.824151 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.824143    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:36:23.824249 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.824115    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:36:23.824249 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.824196    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:36:23.825200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.825188    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.825256 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.825210    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 01:36:23.826393 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.826376    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 01:36:23.826457 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.826403    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 01:36:23.826457 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.826412    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID"
Jul 21 01:36:23.840858 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.840839    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-80.ec2.internal\" not found" node="ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.844984 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.844969    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-80.ec2.internal\" not found" node="ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.863718 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.863701    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:23.946859 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.946839    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65a654ee8a244970172bd124da94b553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"65a654ee8a244970172bd124da94b553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.946859 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.946866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65a654ee8a244970172bd124da94b553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"65a654ee8a244970172bd124da94b553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.947001 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:23.946882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/136b9eb90b068a35c8b9176c00f34cf5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-80.ec2.internal\" (UID: \"136b9eb90b068a35c8b9176c00f34cf5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:23.963889 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:23.963872    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:24.047532 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.047507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65a654ee8a244970172bd124da94b553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"65a654ee8a244970172bd124da94b553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.047617 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.047536    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65a654ee8a244970172bd124da94b553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"65a654ee8a244970172bd124da94b553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.047617 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.047555    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/136b9eb90b068a35c8b9176c00f34cf5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-80.ec2.internal\" (UID: \"136b9eb90b068a35c8b9176c00f34cf5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.047617 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.047579    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/136b9eb90b068a35c8b9176c00f34cf5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-80.ec2.internal\" (UID: \"136b9eb90b068a35c8b9176c00f34cf5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.047617 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.047607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/65a654ee8a244970172bd124da94b553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"65a654ee8a244970172bd124da94b553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.047799 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.047612    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65a654ee8a244970172bd124da94b553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"65a654ee8a244970172bd124da94b553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.064629 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:24.064610    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:24.143842 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.143822    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.147747 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.147669    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.165290 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:24.165267    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:24.265767 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:24.265744    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:24.366315 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:24.366285    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:24.466778 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:24.466714    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found"
Jul 21 01:36:24.475886 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.475863    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 01:36:24.476004 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.475986    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 01:36:24.561615 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.561583    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:36:24.606439 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.606417    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:36:24.645161 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.645139    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.652375 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.652347    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 01:31:23 +0000 UTC" deadline="2028-03-11 17:04:44.640659477 +0000 UTC"
Jul 21 01:36:24.652375 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.652373    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14391h28m19.988289564s"
Jul 21 01:36:24.657975 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.657961    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 01:36:24.660896 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.660878    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal"
Jul 21 01:36:24.666811 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.666793    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 01:36:24.711589 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:24.711562    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a654ee8a244970172bd124da94b553.slice/crio-92bd7d62d6df10a7f8fee47e05a44e6b42ad6a8cea085546e03949c7e54034fc WatchSource:0}: Error finding container 92bd7d62d6df10a7f8fee47e05a44e6b42ad6a8cea085546e03949c7e54034fc: Status 404 returned error can't find the container with id 92bd7d62d6df10a7f8fee47e05a44e6b42ad6a8cea085546e03949c7e54034fc
Jul 21 01:36:24.712047 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:24.712029    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136b9eb90b068a35c8b9176c00f34cf5.slice/crio-51552f553ee11412f88b4e910eb35dab1970a8b878e22d36574cda391cba049c WatchSource:0}: Error finding container 51552f553ee11412f88b4e910eb35dab1970a8b878e22d36574cda391cba049c: Status 404 returned error can't find the container with id 51552f553ee11412f88b4e910eb35dab1970a8b878e22d36574cda391cba049c
Jul 21 01:36:24.716573 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.716555    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:36:24.725183 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.725146    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" event={"ID":"65a654ee8a244970172bd124da94b553","Type":"ContainerStarted","Data":"92bd7d62d6df10a7f8fee47e05a44e6b42ad6a8cea085546e03949c7e54034fc"}
Jul 21 01:36:24.726061 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:24.726036    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" event={"ID":"136b9eb90b068a35c8b9176c00f34cf5","Type":"ContainerStarted","Data":"51552f553ee11412f88b4e910eb35dab1970a8b878e22d36574cda391cba049c"}
Jul 21 01:36:25.035005 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.034913    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:36:25.526829 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.526801    2568 apiserver.go:52] "Watching apiserver"
Jul 21 01:36:25.534074 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.534049    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 01:36:25.534579 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.534548    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-rm77x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal","openshift-multus/multus-59sw8","openshift-multus/multus-additional-cni-plugins-d4cf7","openshift-network-diagnostics/network-check-target-tfjtg","openshift-network-operator/iptables-alerter-crj77","kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7tppj","openshift-dns/node-resolver-d5w56","openshift-image-registry/node-ca-dn56p","openshift-multus/network-metrics-daemon-v4dpq","openshift-ovn-kubernetes/ovnkube-node-8jn6q","kube-system/global-pull-secret-syncer-pz2tk"]
Jul 21 01:36:25.536376 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.536353    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.538464 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.538438    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.538920 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.538898    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lttgh\""
Jul 21 01:36:25.539183 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.539160    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 01:36:25.539782 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.539637    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:36:25.539958 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.539945    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.540091 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.540022    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:25.541553 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.541044    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 01:36:25.541553 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.541300    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 01:36:25.542374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.541810    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 01:36:25.542374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.541848    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.542684 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.542666    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 01:36:25.542758 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.542721    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 01:36:25.542758 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.542675    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52l9p\""
Jul 21 01:36:25.543019 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.542998    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 01:36:25.543135 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.543117    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 01:36:25.543576 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.543557    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.544010 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.543974    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 01:36:25.544589 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.544455    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 01:36:25.544589 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.544471    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 01:36:25.544589 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.544483    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xbkjd\""
Jul 21 01:36:25.544589 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.544460    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 01:36:25.545057 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.544957    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 01:36:25.545662 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.545476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 01:36:25.545760 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.545739    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g855s\""
Jul 21 01:36:25.545822 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.545794    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 01:36:25.546057 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.545987    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:25.546057 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.546048    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:25.547472 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.547454    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.550277 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.549181    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:25.550787 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.550379    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c5k5h\""
Jul 21 01:36:25.551142 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.551122    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:36:25.552028 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.551356    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 01:36:25.553381 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.552276    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 01:36:25.553381 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.552332    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 01:36:25.553381 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.552576    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zdfzr\""
Jul 21 01:36:25.554249 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.554155    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556528    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556619    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-system-cni-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556650    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-kubelet\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556674    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qzbw\" (UniqueName: \"kubernetes.io/projected/352bf5db-4e9a-493d-8617-d04d32e3effe-kube-api-access-7qzbw\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556698    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-os-release\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-var-lib-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-log-socket\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556838    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-kubelet-config\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-cni-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556906    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-cnibin\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.556957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556949    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.556991    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc9dj\" (UniqueName: \"kubernetes.io/projected/313cecc1-0db3-4e07-974c-8d6304f7aff9-kube-api-access-zc9dj\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557026    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-iptables-alerter-script\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-cni-bin\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557071    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70662634-e84b-42db-9617-6d9dc01cc36b-ovn-node-metrics-cert\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-netns\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557142    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-cni-multus\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557166    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557190    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-etc-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557202    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557212    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-cni-netd\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-ovnkube-config\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-socket-dir-parent\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557279    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-daemon-config\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557303    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-ovn\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.557545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-dbus\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557413    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557533    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557666    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p5lx4\""
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-k8s-cni-cncf-io\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-hostroot\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-conf-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-multus-certs\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-systemd\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-node-log\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-ovnkube-script-lib\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-host-slash\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557904    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-env-overrides\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557926    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/352bf5db-4e9a-493d-8617-d04d32e3effe-cni-binary-copy\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-etc-kubernetes\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.557982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-system-cni-dir\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.558357 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558007    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2nln\" (UniqueName: \"kubernetes.io/projected/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-kube-api-access-w2nln\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558077    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-slash\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558107    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-run-netns\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-os-release\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558176    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-cni-bin\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558182    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-cnibin\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-kubelet\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-systemd-units\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558286    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558327    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns2w7\" (UniqueName: \"kubernetes.io/projected/70662634-e84b-42db-9617-6d9dc01cc36b-kube-api-access-ns2w7\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558524    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.558921    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z8wv2\""
Jul 21 01:36:25.559200 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.559122    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 01:36:25.559897 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.559522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:25.559897 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.559586    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:25.560057 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.560039    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 01:36:25.560368 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.560337    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 01:36:25.560461 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.560425    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mlcvp\""
Jul 21 01:36:25.560532 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.560463    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 01:36:25.562266 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.562246    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 01:36:25.587089 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.587061    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-24h2d"
Jul 21 01:36:25.595950 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.595925    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-24h2d"
Jul 21 01:36:25.646192 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.646169    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-host\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-etc-kubernetes\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659574    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-kubelet\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-systemd-units\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs6xv\" (UniqueName: \"kubernetes.io/projected/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-kube-api-access-qs6xv\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659725    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90673ea3-b76b-4942-8087-b7e19186ea4c-host\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659758    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-kubelet\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659787    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-os-release\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-log-socket\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659837    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-modprobe-d\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-run\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659929    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc9dj\" (UniqueName: \"kubernetes.io/projected/313cecc1-0db3-4e07-974c-8d6304f7aff9-kube-api-access-zc9dj\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659962    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-iptables-alerter-script\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.659988    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-cni-bin\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.662077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660015    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51848622-0cb1-4a6e-ad02-b65b3eeddc97-tmp\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660042    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-cni-netd\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-ovnkube-config\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-ovn\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660123    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9da9e6bc-7d4d-4697-becd-360d85131b1d-agent-certs\") pod \"konnectivity-agent-rm77x\" (UID: \"9da9e6bc-7d4d-4697-becd-360d85131b1d\") " pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660151    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysctl-conf\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660178    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-var-lib-kubelet\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-tuned\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-k8s-cni-cncf-io\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660265    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-hostroot\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-systemd\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660377    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90673ea3-b76b-4942-8087-b7e19186ea4c-serviceca\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w266j\" (UniqueName: \"kubernetes.io/projected/8b7586e5-a575-491c-a704-8f4bf097a9bb-kube-api-access-w266j\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-host-slash\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9da9e6bc-7d4d-4697-becd-360d85131b1d-konnectivity-ca\") pod \"konnectivity-agent-rm77x\" (UID: \"9da9e6bc-7d4d-4697-becd-360d85131b1d\") " pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660495    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-tmp-dir\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.663055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/352bf5db-4e9a-493d-8617-d04d32e3effe-cni-binary-copy\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-system-cni-dir\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660621    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660656    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2nln\" (UniqueName: \"kubernetes.io/projected/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-kube-api-access-w2nln\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-slash\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-run-netns\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns2w7\" (UniqueName: \"kubernetes.io/projected/70662634-e84b-42db-9617-6d9dc01cc36b-kube-api-access-ns2w7\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-os-release\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-cni-bin\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660855    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-cnibin\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660891    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660919    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-kubelet-config\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.660982    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-system-cni-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzbw\" (UniqueName: \"kubernetes.io/projected/352bf5db-4e9a-493d-8617-d04d32e3effe-kube-api-access-7qzbw\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661040    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-var-lib-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.663788 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661072    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-registration-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-device-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661162    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-hostroot\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661241    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-etc-kubernetes\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661298    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661370    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-kubelet\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661441    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-systemd-units\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-systemd\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-kubelet\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661561    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-cni-netd\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661650    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-k8s-cni-cncf-io\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661675    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-var-lib-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661691    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-kubelet-config\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-slash\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661694    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-cni-bin\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661764    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-os-release\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661761    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-system-cni-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-os-release\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.664563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661857    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-log-socket\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661871    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-host-slash\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661931    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-cnibin\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.661935    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-system-cni-dir\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.662057    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-cni-bin\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.662110    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhcj2\" (UniqueName: \"kubernetes.io/projected/3622f0cd-334d-46c6-8640-53aca7776588-kube-api-access-vhcj2\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.662385    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.662684    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-iptables-alerter-script\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.662771    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-run-ovn\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.663724    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-run-netns\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.663840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-hosts-file\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.663883    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.663938    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysctl-d\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.663988    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-cni-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-cnibin\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664074    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70662634-e84b-42db-9617-6d9dc01cc36b-ovn-node-metrics-cert\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664095    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-cnibin\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665374 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664101    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/352bf5db-4e9a-493d-8617-d04d32e3effe-cni-binary-copy\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664157    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-cni-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs789\" (UniqueName: \"kubernetes.io/projected/90673ea3-b76b-4942-8087-b7e19186ea4c-kube-api-access-xs789\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.664267    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-ovnkube-config\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664319    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-netns\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-cni-multus\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664371    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-netns\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.664418    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret podName:9fe3eb07-b8c1-4f5d-9773-b6633b6a9230 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:26.164381504 +0000 UTC m=+3.009375096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret") pod "global-pull-secret-syncer-pz2tk" (UID: "9fe3eb07-b8c1-4f5d-9773-b6633b6a9230") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664422    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-var-lib-cni-multus\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664440    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664467    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-etc-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664470    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664527    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-systemd\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664560    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85nct\" (UniqueName: \"kubernetes.io/projected/51848622-0cb1-4a6e-ad02-b65b3eeddc97-kube-api-access-85nct\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.665954 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-etc-openvswitch\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-socket-dir-parent\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664619    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/313cecc1-0db3-4e07-974c-8d6304f7aff9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-daemon-config\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664658    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-socket-dir-parent\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664693    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-dbus\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664745    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664761    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-conf-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664787    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-multus-certs\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664799    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-dbus\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664803    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-conf-dir\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-node-log\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664840    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/352bf5db-4e9a-493d-8617-d04d32e3effe-host-run-multus-certs\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664846    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70662634-e84b-42db-9617-6d9dc01cc36b-node-log\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.666598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-ovnkube-script-lib\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664880    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-socket-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664905    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-kubernetes\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664927    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-sys\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664950    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-lib-modules\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.664976    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-env-overrides\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.665000    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-sys-fs\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.665027    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysconfig\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.665108    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/352bf5db-4e9a-493d-8617-d04d32e3effe-multus-daemon-config\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.665166    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/313cecc1-0db3-4e07-974c-8d6304f7aff9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.665332    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-ovnkube-script-lib\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.667167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.665412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70662634-e84b-42db-9617-6d9dc01cc36b-env-overrides\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.667628 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.667383    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:36:25.667628 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.667405    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:36:25.667628 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.667417    2568 projected.go:196] Error preparing data for projected volume kube-api-access-wwdhr for pod openshift-network-diagnostics/network-check-target-tfjtg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:25.667628 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.667486    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr podName:65f3b611-8116-48be-9fcb-60f2fa2cc140 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:26.167472004 +0000 UTC m=+3.012465590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wwdhr" (UniqueName: "kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr") pod "network-check-target-tfjtg" (UID: "65f3b611-8116-48be-9fcb-60f2fa2cc140") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:25.668120 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.668097    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70662634-e84b-42db-9617-6d9dc01cc36b-ovn-node-metrics-cert\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.669604 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.669582    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2nln\" (UniqueName: \"kubernetes.io/projected/b2cfd565-3fb6-4c0a-85d1-6e6dc0617528-kube-api-access-w2nln\") pod \"iptables-alerter-crj77\" (UID: \"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528\") " pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.670195 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.670176    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns2w7\" (UniqueName: \"kubernetes.io/projected/70662634-e84b-42db-9617-6d9dc01cc36b-kube-api-access-ns2w7\") pod \"ovnkube-node-8jn6q\" (UID: \"70662634-e84b-42db-9617-6d9dc01cc36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.671285 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.671265    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qzbw\" (UniqueName: \"kubernetes.io/projected/352bf5db-4e9a-493d-8617-d04d32e3effe-kube-api-access-7qzbw\") pod \"multus-59sw8\" (UID: \"352bf5db-4e9a-493d-8617-d04d32e3effe\") " pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.671963 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.671944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc9dj\" (UniqueName: \"kubernetes.io/projected/313cecc1-0db3-4e07-974c-8d6304f7aff9-kube-api-access-zc9dj\") pod \"multus-additional-cni-plugins-d4cf7\" (UID: \"313cecc1-0db3-4e07-974c-8d6304f7aff9\") " pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.765521 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs6xv\" (UniqueName: \"kubernetes.io/projected/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-kube-api-access-qs6xv\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.765679 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90673ea3-b76b-4942-8087-b7e19186ea4c-host\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.765679 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765553    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-modprobe-d\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765679 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765605    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90673ea3-b76b-4942-8087-b7e19186ea4c-host\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.765679 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-run\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765679 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765662    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-modprobe-d\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765679 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51848622-0cb1-4a6e-ad02-b65b3eeddc97-tmp\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9da9e6bc-7d4d-4697-becd-360d85131b1d-agent-certs\") pod \"konnectivity-agent-rm77x\" (UID: \"9da9e6bc-7d4d-4697-becd-360d85131b1d\") " pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysctl-conf\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765762    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-run\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-var-lib-kubelet\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-tuned\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-var-lib-kubelet\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765837    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysctl-conf\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90673ea3-b76b-4942-8087-b7e19186ea4c-serviceca\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765940    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w266j\" (UniqueName: \"kubernetes.io/projected/8b7586e5-a575-491c-a704-8f4bf097a9bb-kube-api-access-w266j\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9da9e6bc-7d4d-4697-becd-360d85131b1d-konnectivity-ca\") pod \"konnectivity-agent-rm77x\" (UID: \"9da9e6bc-7d4d-4697-becd-360d85131b1d\") " pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:25.765992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.765998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-tmp-dir\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766154    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766187    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-registration-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766212    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-device-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhcj2\" (UniqueName: \"kubernetes.io/projected/3622f0cd-334d-46c6-8640-53aca7776588-kube-api-access-vhcj2\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766262    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-hosts-file\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766285    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysctl-d\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs789\" (UniqueName: \"kubernetes.io/projected/90673ea3-b76b-4942-8087-b7e19186ea4c-kube-api-access-xs789\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766395    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-systemd\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766402    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90673ea3-b76b-4942-8087-b7e19186ea4c-serviceca\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nct\" (UniqueName: \"kubernetes.io/projected/51848622-0cb1-4a6e-ad02-b65b3eeddc97-kube-api-access-85nct\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766455    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-tmp-dir\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-socket-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766496    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-kubernetes\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-sys\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.766561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766539    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9da9e6bc-7d4d-4697-becd-360d85131b1d-konnectivity-ca\") pod \"konnectivity-agent-rm77x\" (UID: \"9da9e6bc-7d4d-4697-becd-360d85131b1d\") " pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-lib-modules\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-sys-fs\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766613    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysconfig\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-host\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-lib-modules\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766673    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-hosts-file\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766719    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-sys-fs\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766721    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-host\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-registration-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766805    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-device-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766820    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-sys\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766838    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-socket-dir\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766857    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-kubernetes\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766858    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-systemd\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766891    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysctl-d\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766776    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-sysconfig\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.767425 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.766931    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:25.768270 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.766939    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3622f0cd-334d-46c6-8640-53aca7776588-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.768270 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:25.767032    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs podName:8b7586e5-a575-491c-a704-8f4bf097a9bb nodeName:}" failed. No retries permitted until 2026-07-21 01:36:26.267015015 +0000 UTC m=+3.112008599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs") pod "network-metrics-daemon-v4dpq" (UID: "8b7586e5-a575-491c-a704-8f4bf097a9bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:25.768270 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.768264    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51848622-0cb1-4a6e-ad02-b65b3eeddc97-etc-tuned\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.769015 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.768993    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51848622-0cb1-4a6e-ad02-b65b3eeddc97-tmp\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.769212 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.769188    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9da9e6bc-7d4d-4697-becd-360d85131b1d-agent-certs\") pod \"konnectivity-agent-rm77x\" (UID: \"9da9e6bc-7d4d-4697-becd-360d85131b1d\") " pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:25.777260 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.777210    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs6xv\" (UniqueName: \"kubernetes.io/projected/9d05c403-0eb3-48c4-8c89-123b9ddcfec0-kube-api-access-qs6xv\") pod \"node-resolver-d5w56\" (UID: \"9d05c403-0eb3-48c4-8c89-123b9ddcfec0\") " pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.777397 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.777370    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85nct\" (UniqueName: \"kubernetes.io/projected/51848622-0cb1-4a6e-ad02-b65b3eeddc97-kube-api-access-85nct\") pod \"tuned-7tppj\" (UID: \"51848622-0cb1-4a6e-ad02-b65b3eeddc97\") " pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.777999 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.777635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhcj2\" (UniqueName: \"kubernetes.io/projected/3622f0cd-334d-46c6-8640-53aca7776588-kube-api-access-vhcj2\") pod \"aws-ebs-csi-driver-node-9jkbd\" (UID: \"3622f0cd-334d-46c6-8640-53aca7776588\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.777999 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.777958    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w266j\" (UniqueName: \"kubernetes.io/projected/8b7586e5-a575-491c-a704-8f4bf097a9bb-kube-api-access-w266j\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:25.778216 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.778194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs789\" (UniqueName: \"kubernetes.io/projected/90673ea3-b76b-4942-8087-b7e19186ea4c-kube-api-access-xs789\") pod \"node-ca-dn56p\" (UID: \"90673ea3-b76b-4942-8087-b7e19186ea4c\") " pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.850093 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.850059    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crj77"
Jul 21 01:36:25.860965 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.860943    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:25.868483 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.868462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-59sw8"
Jul 21 01:36:25.874640 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.874612    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d4cf7"
Jul 21 01:36:25.881680 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.881664    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7tppj"
Jul 21 01:36:25.889001 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.888990    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:25.897582 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.897566    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd"
Jul 21 01:36:25.910103 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.910085    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d5w56"
Jul 21 01:36:25.916653 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.916634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dn56p"
Jul 21 01:36:25.929423 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:25.929407    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 01:36:26.169564 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.169524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:26.169721 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:26.169684    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:26.169721 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.169709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:26.169844 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:26.169756    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret podName:9fe3eb07-b8c1-4f5d-9773-b6633b6a9230 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:27.169735459 +0000 UTC m=+4.014729045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret") pod "global-pull-secret-syncer-pz2tk" (UID: "9fe3eb07-b8c1-4f5d-9773-b6633b6a9230") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:26.169909 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:26.169844    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:36:26.169909 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:26.169864    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:36:26.169909 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:26.169878    2568 projected.go:196] Error preparing data for projected volume kube-api-access-wwdhr for pod openshift-network-diagnostics/network-check-target-tfjtg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:26.170046 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:26.169939    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr podName:65f3b611-8116-48be-9fcb-60f2fa2cc140 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:27.169922435 +0000 UTC m=+4.014916015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwdhr" (UniqueName: "kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr") pod "network-check-target-tfjtg" (UID: "65f3b611-8116-48be-9fcb-60f2fa2cc140") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:26.270883 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.270850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:26.271063 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:26.270991    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:26.271063 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:26.271044    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs podName:8b7586e5-a575-491c-a704-8f4bf097a9bb nodeName:}" failed. No retries permitted until 2026-07-21 01:36:27.271030577 +0000 UTC m=+4.116024151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs") pod "network-metrics-daemon-v4dpq" (UID: "8b7586e5-a575-491c-a704-8f4bf097a9bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:26.444095 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.444061    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51848622_0cb1_4a6e_ad02_b65b3eeddc97.slice/crio-7e33810e1cedca12748765efaf3b96efd771101f6265fb23c930cedbb7e19afc WatchSource:0}: Error finding container 7e33810e1cedca12748765efaf3b96efd771101f6265fb23c930cedbb7e19afc: Status 404 returned error can't find the container with id 7e33810e1cedca12748765efaf3b96efd771101f6265fb23c930cedbb7e19afc
Jul 21 01:36:26.446096 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.446073    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352bf5db_4e9a_493d_8617_d04d32e3effe.slice/crio-69e49ab63ffcdb1d5c713430f69cb3d775f3ac3d6ba83251b094fc82968e8217 WatchSource:0}: Error finding container 69e49ab63ffcdb1d5c713430f69cb3d775f3ac3d6ba83251b094fc82968e8217: Status 404 returned error can't find the container with id 69e49ab63ffcdb1d5c713430f69cb3d775f3ac3d6ba83251b094fc82968e8217
Jul 21 01:36:26.447353 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.447332    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d05c403_0eb3_48c4_8c89_123b9ddcfec0.slice/crio-cd2d09c49b949e951209ef900f98711a7ac70777e5d5b0c6407288f9577f9cdf WatchSource:0}: Error finding container cd2d09c49b949e951209ef900f98711a7ac70777e5d5b0c6407288f9577f9cdf: Status 404 returned error can't find the container with id cd2d09c49b949e951209ef900f98711a7ac70777e5d5b0c6407288f9577f9cdf
Jul 21 01:36:26.448550 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.448528    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da9e6bc_7d4d_4697_becd_360d85131b1d.slice/crio-473d7089ef9d4713ec35b6e78eff7bf34ade819b5d7956da412ef910ff9dee28 WatchSource:0}: Error finding container 473d7089ef9d4713ec35b6e78eff7bf34ade819b5d7956da412ef910ff9dee28: Status 404 returned error can't find the container with id 473d7089ef9d4713ec35b6e78eff7bf34ade819b5d7956da412ef910ff9dee28
Jul 21 01:36:26.449278 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.449243    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70662634_e84b_42db_9617_6d9dc01cc36b.slice/crio-0c31dc2f62383cbc0c511fafb45db445d4e2ecc25d31b85fbaaf4d6571ea09f1 WatchSource:0}: Error finding container 0c31dc2f62383cbc0c511fafb45db445d4e2ecc25d31b85fbaaf4d6571ea09f1: Status 404 returned error can't find the container with id 0c31dc2f62383cbc0c511fafb45db445d4e2ecc25d31b85fbaaf4d6571ea09f1
Jul 21 01:36:26.450841 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.450809    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90673ea3_b76b_4942_8087_b7e19186ea4c.slice/crio-d95a6582a1075e6ee6e9a0795143862558fcc62492e7e4690f37e2901606ae4a WatchSource:0}: Error finding container d95a6582a1075e6ee6e9a0795143862558fcc62492e7e4690f37e2901606ae4a: Status 404 returned error can't find the container with id d95a6582a1075e6ee6e9a0795143862558fcc62492e7e4690f37e2901606ae4a
Jul 21 01:36:26.452179 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.452114    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3622f0cd_334d_46c6_8640_53aca7776588.slice/crio-c1888545b61de20c89256133440cbc8c67f9e8875cdca7f9897520b5627ed3f1 WatchSource:0}: Error finding container c1888545b61de20c89256133440cbc8c67f9e8875cdca7f9897520b5627ed3f1: Status 404 returned error can't find the container with id c1888545b61de20c89256133440cbc8c67f9e8875cdca7f9897520b5627ed3f1
Jul 21 01:36:26.453030 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.452531    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313cecc1_0db3_4e07_974c_8d6304f7aff9.slice/crio-261ecb20678639b37c8315ca54492213bcf46ed21c2156e290ecbad69d79d24f WatchSource:0}: Error finding container 261ecb20678639b37c8315ca54492213bcf46ed21c2156e290ecbad69d79d24f: Status 404 returned error can't find the container with id 261ecb20678639b37c8315ca54492213bcf46ed21c2156e290ecbad69d79d24f
Jul 21 01:36:26.453814 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:26.453774    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cfd565_3fb6_4c0a_85d1_6e6dc0617528.slice/crio-1deb74583c2a7fe766055cca69bc0d913ab48de8a5c23a9b221c544b7aef87c9 WatchSource:0}: Error finding container 1deb74583c2a7fe766055cca69bc0d913ab48de8a5c23a9b221c544b7aef87c9: Status 404 returned error can't find the container with id 1deb74583c2a7fe766055cca69bc0d913ab48de8a5c23a9b221c544b7aef87c9
Jul 21 01:36:26.598345 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.598282    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:31:25 +0000 UTC" deadline="2028-04-20 11:57:50.283384694 +0000 UTC"
Jul 21 01:36:26.598345 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.598339    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15346h21m23.68504814s"
Jul 21 01:36:26.730449 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.730181    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" event={"ID":"136b9eb90b068a35c8b9176c00f34cf5","Type":"ContainerStarted","Data":"378448b785e7c455916d88fe383346d3c1bcadf006ae107371499306ec296fc0"}
Jul 21 01:36:26.731201 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.731179    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd" event={"ID":"3622f0cd-334d-46c6-8640-53aca7776588","Type":"ContainerStarted","Data":"c1888545b61de20c89256133440cbc8c67f9e8875cdca7f9897520b5627ed3f1"}
Jul 21 01:36:26.732152 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.732133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dn56p" event={"ID":"90673ea3-b76b-4942-8087-b7e19186ea4c","Type":"ContainerStarted","Data":"d95a6582a1075e6ee6e9a0795143862558fcc62492e7e4690f37e2901606ae4a"}
Jul 21 01:36:26.733209 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.733187    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"0c31dc2f62383cbc0c511fafb45db445d4e2ecc25d31b85fbaaf4d6571ea09f1"}
Jul 21 01:36:26.734165 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.734140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rm77x" event={"ID":"9da9e6bc-7d4d-4697-becd-360d85131b1d","Type":"ContainerStarted","Data":"473d7089ef9d4713ec35b6e78eff7bf34ade819b5d7956da412ef910ff9dee28"}
Jul 21 01:36:26.735055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.735037    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7tppj" event={"ID":"51848622-0cb1-4a6e-ad02-b65b3eeddc97","Type":"ContainerStarted","Data":"7e33810e1cedca12748765efaf3b96efd771101f6265fb23c930cedbb7e19afc"}
Jul 21 01:36:26.736270 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.736249    2568 generic.go:356] "Generic (PLEG): container finished" podID="65a654ee8a244970172bd124da94b553" containerID="19631d97b11a02dbe311fe0d46e9bd5a9c14b80e62529a53459b95a2f0dec5ee" exitCode=0
Jul 21 01:36:26.736368 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.736323    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" event={"ID":"65a654ee8a244970172bd124da94b553","Type":"ContainerDied","Data":"19631d97b11a02dbe311fe0d46e9bd5a9c14b80e62529a53459b95a2f0dec5ee"}
Jul 21 01:36:26.737403 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.737381    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crj77" event={"ID":"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528","Type":"ContainerStarted","Data":"1deb74583c2a7fe766055cca69bc0d913ab48de8a5c23a9b221c544b7aef87c9"}
Jul 21 01:36:26.738359 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.738319    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" event={"ID":"313cecc1-0db3-4e07-974c-8d6304f7aff9","Type":"ContainerStarted","Data":"261ecb20678639b37c8315ca54492213bcf46ed21c2156e290ecbad69d79d24f"}
Jul 21 01:36:26.739282 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.739264    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d5w56" event={"ID":"9d05c403-0eb3-48c4-8c89-123b9ddcfec0","Type":"ContainerStarted","Data":"cd2d09c49b949e951209ef900f98711a7ac70777e5d5b0c6407288f9577f9cdf"}
Jul 21 01:36:26.740226 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.740208    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-59sw8" event={"ID":"352bf5db-4e9a-493d-8617-d04d32e3effe","Type":"ContainerStarted","Data":"69e49ab63ffcdb1d5c713430f69cb3d775f3ac3d6ba83251b094fc82968e8217"}
Jul 21 01:36:26.743364 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:26.743329    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" podStartSLOduration=2.743300414 podStartE2EDuration="2.743300414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:26.743182092 +0000 UTC m=+3.588175686" watchObservedRunningTime="2026-07-21 01:36:26.743300414 +0000 UTC m=+3.588294009"
Jul 21 01:36:27.178902 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.178866    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:27.179086 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.178960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:27.179162 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.179111    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:36:27.179162 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.179132    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:36:27.179162 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.179143    2568 projected.go:196] Error preparing data for projected volume kube-api-access-wwdhr for pod openshift-network-diagnostics/network-check-target-tfjtg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:27.179353 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.179198    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr podName:65f3b611-8116-48be-9fcb-60f2fa2cc140 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:29.179180119 +0000 UTC m=+6.024173694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwdhr" (UniqueName: "kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr") pod "network-check-target-tfjtg" (UID: "65f3b611-8116-48be-9fcb-60f2fa2cc140") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:27.179614 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.179597    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:27.179693 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.179653    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret podName:9fe3eb07-b8c1-4f5d-9773-b6633b6a9230 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:29.179638264 +0000 UTC m=+6.024631842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret") pod "global-pull-secret-syncer-pz2tk" (UID: "9fe3eb07-b8c1-4f5d-9773-b6633b6a9230") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:27.280344 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.279804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:27.280344 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.279952    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:27.280344 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.280008    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs podName:8b7586e5-a575-491c-a704-8f4bf097a9bb nodeName:}" failed. No retries permitted until 2026-07-21 01:36:29.279991494 +0000 UTC m=+6.124985067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs") pod "network-metrics-daemon-v4dpq" (UID: "8b7586e5-a575-491c-a704-8f4bf097a9bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:27.599061 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.599018    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 01:31:25 +0000 UTC" deadline="2028-04-14 02:45:10.65422676 +0000 UTC"
Jul 21 01:36:27.599061 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.599060    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15193h8m43.055171516s"
Jul 21 01:36:27.723488 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.723414    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:27.723642 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.723543    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:27.723938 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.723920    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:27.724027 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.724009    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:27.724101 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.724076    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:27.724169 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:27.724154    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:27.748412 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:27.748379    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" event={"ID":"65a654ee8a244970172bd124da94b553","Type":"ContainerStarted","Data":"a12d5ec85b2528a7584c9757e37879f8d434f6e64d99e81c9db1b340994221a3"}
Jul 21 01:36:29.195745 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:29.195695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:29.196199 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:29.195763    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:29.196199 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.195910    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:29.196199 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.195967    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret podName:9fe3eb07-b8c1-4f5d-9773-b6633b6a9230 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:33.195950071 +0000 UTC m=+10.040943664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret") pod "global-pull-secret-syncer-pz2tk" (UID: "9fe3eb07-b8c1-4f5d-9773-b6633b6a9230") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:29.196448 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.196409    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:36:29.196448 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.196430    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:36:29.196448 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.196442    2568 projected.go:196] Error preparing data for projected volume kube-api-access-wwdhr for pod openshift-network-diagnostics/network-check-target-tfjtg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:29.196612 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.196490    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr podName:65f3b611-8116-48be-9fcb-60f2fa2cc140 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:33.196474435 +0000 UTC m=+10.041468028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwdhr" (UniqueName: "kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr") pod "network-check-target-tfjtg" (UID: "65f3b611-8116-48be-9fcb-60f2fa2cc140") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:29.296660 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:29.296615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:29.296827 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.296787    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:29.296887 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.296843    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs podName:8b7586e5-a575-491c-a704-8f4bf097a9bb nodeName:}" failed. No retries permitted until 2026-07-21 01:36:33.296826409 +0000 UTC m=+10.141819996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs") pod "network-metrics-daemon-v4dpq" (UID: "8b7586e5-a575-491c-a704-8f4bf097a9bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:29.723903 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:29.723091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:29.723903 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.723209    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:29.723903 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:29.723610    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:29.723903 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.723711    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:29.723903 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:29.723787    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:29.723903 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:29.723858    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:31.720795 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:31.720718    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:31.721232 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:31.720846    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:31.721232 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:31.721208    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:31.721406 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:31.721290    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:31.721469 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:31.721436    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:31.721556 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:31.721536    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:33.227983 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:33.227795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:33.227983 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:33.227861    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:33.227983 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.227963    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:36:33.227983 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.227981    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:36:33.227983 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.227993    2568 projected.go:196] Error preparing data for projected volume kube-api-access-wwdhr for pod openshift-network-diagnostics/network-check-target-tfjtg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:33.228635 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.228046    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr podName:65f3b611-8116-48be-9fcb-60f2fa2cc140 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:41.228028434 +0000 UTC m=+18.073022020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwdhr" (UniqueName: "kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr") pod "network-check-target-tfjtg" (UID: "65f3b611-8116-48be-9fcb-60f2fa2cc140") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:33.228635 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.227960    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:33.228635 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.228235    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret podName:9fe3eb07-b8c1-4f5d-9773-b6633b6a9230 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:41.228199586 +0000 UTC m=+18.073193163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret") pod "global-pull-secret-syncer-pz2tk" (UID: "9fe3eb07-b8c1-4f5d-9773-b6633b6a9230") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:33.329108 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:33.329060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:33.329283 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.329189    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:33.329283 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.329252    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs podName:8b7586e5-a575-491c-a704-8f4bf097a9bb nodeName:}" failed. No retries permitted until 2026-07-21 01:36:41.329233111 +0000 UTC m=+18.174226697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs") pod "network-metrics-daemon-v4dpq" (UID: "8b7586e5-a575-491c-a704-8f4bf097a9bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:33.722629 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:33.721353    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:33.722629 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.721482    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:33.722629 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:33.721547    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:33.722629 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.721616    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:33.722629 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:33.721656    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:33.722629 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:33.721716    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:35.721339 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:35.721283    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:35.721339 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:35.721336    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:35.721849 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:35.721286    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:35.721849 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:35.721435    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:35.721849 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:35.721507    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:35.721849 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:35.721581    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:37.720424 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:37.720387    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:37.720424 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:37.720413    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:37.720940 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:37.720387    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:37.720940 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:37.720517    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:37.720940 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:37.720597    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:37.721299 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:37.721268    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:39.721012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:39.720978    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:39.721012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:39.721012    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:39.721549 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:39.721092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:39.721549 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:39.721107    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:39.721549 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:39.721196    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:39.721549 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:39.721295    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:41.287897 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:41.287860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:41.288422 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:41.287929    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:41.288422 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.288005    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:36:41.288422 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.288025    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:41.288422 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.288030    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:36:41.288422 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.288045    2568 projected.go:196] Error preparing data for projected volume kube-api-access-wwdhr for pod openshift-network-diagnostics/network-check-target-tfjtg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:41.288422 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.288089    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr podName:65f3b611-8116-48be-9fcb-60f2fa2cc140 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:57.288071834 +0000 UTC m=+34.133065407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwdhr" (UniqueName: "kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr") pod "network-check-target-tfjtg" (UID: "65f3b611-8116-48be-9fcb-60f2fa2cc140") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:41.288422 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.288106    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret podName:9fe3eb07-b8c1-4f5d-9773-b6633b6a9230 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:57.288098417 +0000 UTC m=+34.133091990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret") pod "global-pull-secret-syncer-pz2tk" (UID: "9fe3eb07-b8c1-4f5d-9773-b6633b6a9230") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:41.388302 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:41.388271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:41.388487 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.388395    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:41.388487 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.388448    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs podName:8b7586e5-a575-491c-a704-8f4bf097a9bb nodeName:}" failed. No retries permitted until 2026-07-21 01:36:57.388433583 +0000 UTC m=+34.233427155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs") pod "network-metrics-daemon-v4dpq" (UID: "8b7586e5-a575-491c-a704-8f4bf097a9bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:41.721185 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:41.721156    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:41.721393 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:41.721157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:41.721393 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.721292    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:41.721393 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:41.721166    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:41.721393 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.721381    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:41.721622 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:41.721490    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:43.724260 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:43.724228    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:43.724260 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:43.724251    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:43.724260 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:43.724259    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:43.724779 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:43.724363    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:43.724779 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:43.724501    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:43.724779 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:43.724579    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:45.723498 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.723353    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:45.724078 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.723356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:45.724078 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:45.723572    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:45.724078 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.723356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:45.724078 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:45.723640    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:45.724078 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:45.723727    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:45.784343 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.784301    2568 generic.go:356] "Generic (PLEG): container finished" podID="313cecc1-0db3-4e07-974c-8d6304f7aff9" containerID="b996ef2d5cbfbdc40697ef0380d739f191176fccad2d608657ba93150e7c5cb4" exitCode=0
Jul 21 01:36:45.784458 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.784344    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" event={"ID":"313cecc1-0db3-4e07-974c-8d6304f7aff9","Type":"ContainerDied","Data":"b996ef2d5cbfbdc40697ef0380d739f191176fccad2d608657ba93150e7c5cb4"}
Jul 21 01:36:45.785920 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.785897    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d5w56" event={"ID":"9d05c403-0eb3-48c4-8c89-123b9ddcfec0","Type":"ContainerStarted","Data":"7219c299c9cf558095557dc959163e9348b4728dc94319f0d72b90927c8d9bfc"}
Jul 21 01:36:45.787601 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.787583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-59sw8" event={"ID":"352bf5db-4e9a-493d-8617-d04d32e3effe","Type":"ContainerStarted","Data":"ccaaa846da42c83ae9274b6ec648367d1f1f2edeae8c187fd43a36c3819f7869"}
Jul 21 01:36:45.789224 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.789201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd" event={"ID":"3622f0cd-334d-46c6-8640-53aca7776588","Type":"ContainerStarted","Data":"320be05aa5a43bc0b8792b5be567cf0e1e504429a6b4e44d7ac6381b6d3786bc"}
Jul 21 01:36:45.790613 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.790578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dn56p" event={"ID":"90673ea3-b76b-4942-8087-b7e19186ea4c","Type":"ContainerStarted","Data":"6fd9cb91f1b46117412ef76a4f996dfeb4f1bcb2f73d8d808ab650e538697c01"}
Jul 21 01:36:45.792456 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.792438    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"11fefd45f1f802c6e2f67a660663e1fd3d0e2a4fc8a57cf96152e0db6ed75032"}
Jul 21 01:36:45.792541 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.792500    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"4061d444be13015c97b14cd2cebc3ea5ec82f897fbb83f5c134bc3c7512ec558"}
Jul 21 01:36:45.792541 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.792531    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"77c7f5149d359279c61ba2571b3b956a49c4aba2e11d6503a4b559309e8c51ec"}
Jul 21 01:36:45.793632 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.793616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rm77x" event={"ID":"9da9e6bc-7d4d-4697-becd-360d85131b1d","Type":"ContainerStarted","Data":"4c8aefa574fb7582a58570b79be46132f9a03d306b775f5662af418acbc19f9a"}
Jul 21 01:36:45.794826 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.794809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7tppj" event={"ID":"51848622-0cb1-4a6e-ad02-b65b3eeddc97","Type":"ContainerStarted","Data":"0e1c8e797e93efb02eb0d4b5e116d87ceeb3713150b6980c96c8f36f7c6ef06e"}
Jul 21 01:36:45.805047 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.804998    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" podStartSLOduration=21.804987459 podStartE2EDuration="21.804987459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:27.764180739 +0000 UTC m=+4.609174335" watchObservedRunningTime="2026-07-21 01:36:45.804987459 +0000 UTC m=+22.649981054"
Jul 21 01:36:45.820514 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.820475    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-59sw8" podStartSLOduration=4.066784052 podStartE2EDuration="22.820463321s" totalImagesPullingTime="18.753679269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:45.820017335 +0000 UTC m=+22.665010930" watchObservedRunningTime="2026-07-21 01:36:45.820463321 +0000 UTC m=+22.665456917"
Jul 21 01:36:45.836796 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.836759    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7tppj" podStartSLOduration=4.086650817 podStartE2EDuration="22.836745846s" totalImagesPullingTime="18.750095029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:45.836454252 +0000 UTC m=+22.681447848" watchObservedRunningTime="2026-07-21 01:36:45.836745846 +0000 UTC m=+22.681739475"
Jul 21 01:36:45.852867 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.852834    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rm77x" podStartSLOduration=8.896228489 podStartE2EDuration="22.852822246s" totalImagesPullingTime="13.956593757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:45.852547092 +0000 UTC m=+22.697540688" watchObservedRunningTime="2026-07-21 01:36:45.852822246 +0000 UTC m=+22.697815841"
Jul 21 01:36:45.868130 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.868089    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d5w56" podStartSLOduration=4.149588444 podStartE2EDuration="22.868072826s" totalImagesPullingTime="18.718484382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:45.867811054 +0000 UTC m=+22.712804668" watchObservedRunningTime="2026-07-21 01:36:45.868072826 +0000 UTC m=+22.713066422"
Jul 21 01:36:45.882691 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:45.882659    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dn56p" podStartSLOduration=4.167615355 podStartE2EDuration="22.882646882s" totalImagesPullingTime="18.715031527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:45.882462794 +0000 UTC m=+22.727456391" watchObservedRunningTime="2026-07-21 01:36:45.882646882 +0000 UTC m=+22.727640477"
Jul 21 01:36:46.415550 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.415518    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:46.416297 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.416278    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:46.698539 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.698516    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 01:36:46.798805 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.798734    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crj77" event={"ID":"b2cfd565-3fb6-4c0a-85d1-6e6dc0617528","Type":"ContainerStarted","Data":"fa2ecd102e71849077581a69a0dd02d57982bd86a4074f4824f4463712a17899"}
Jul 21 01:36:46.800784 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.800733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd" event={"ID":"3622f0cd-334d-46c6-8640-53aca7776588","Type":"ContainerStarted","Data":"25202c7b9f9b0a2f1a5151410276ce07e8ebef4c761f1abc22fec9cb8c73b7f1"}
Jul 21 01:36:46.804356 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.804322    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"972d4b99dc8407d18b2f233fdb0429bae1abd808d88a2b2317865e003ef6ba87"}
Jul 21 01:36:46.804450 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.804396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"6359c8b9beafd5e453ac96450def534cb682239b1fac38ea2aeb45612b0e3af7"}
Jul 21 01:36:46.804513 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.804449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"1b3fd94baaae809d0689e2e2aa84a968a25a230d3df029a689486d8d1e5f9b63"}
Jul 21 01:36:46.804820 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.804723    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:46.805274 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.805255    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rm77x"
Jul 21 01:36:46.812996 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:46.812958    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-crj77" podStartSLOduration=5.072371177 podStartE2EDuration="23.812945437s" totalImagesPullingTime="18.74057426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:46.812540247 +0000 UTC m=+23.657533865" watchObservedRunningTime="2026-07-21 01:36:46.812945437 +0000 UTC m=+23.657939032"
Jul 21 01:36:47.614607 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:47.614511    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T01:36:46.698537473Z","UUID":"33062a92-1396-4643-b5a3-de6ebacf8cb5","Handler":null,"Name":"","Endpoint":""}
Jul 21 01:36:47.616143 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:47.616116    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 01:36:47.616270 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:47.616163    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 01:36:47.720679 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:47.720648    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:47.720822 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:47.720649    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:47.720822 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:47.720749    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:47.720920 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:47.720822    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:47.720920 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:47.720648    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:47.721127 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:47.721104    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:48.812950 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:48.812909    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"3d49b175501f9500ecef9a5e82cf35d7114811ba4aa048ce372493f62e6b01bc"}
Jul 21 01:36:48.815055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:48.815023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd" event={"ID":"3622f0cd-334d-46c6-8640-53aca7776588","Type":"ContainerStarted","Data":"5981b4506a657759a0cf157ada23083450acd7afd0504cbd280070421ab8a407"}
Jul 21 01:36:48.833797 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:48.833761    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jkbd" podStartSLOduration=4.925915123 podStartE2EDuration="25.833749016s" totalImagesPullingTime="20.907833893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:48.83351384 +0000 UTC m=+25.678507437" watchObservedRunningTime="2026-07-21 01:36:48.833749016 +0000 UTC m=+25.678742615"
Jul 21 01:36:49.720999 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:49.720968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:49.721189 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:49.720968    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:49.721189 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:49.721107    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:49.721189 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:49.721089    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:49.721369 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:49.721223    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:49.721422 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:49.721362    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:50.821106 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:50.820940    2568 generic.go:356] "Generic (PLEG): container finished" podID="313cecc1-0db3-4e07-974c-8d6304f7aff9" containerID="c9cb2680a9fb1a45ec1eade93f0582eba05d565e1b1a8d869d44a572d9725b7c" exitCode=0
Jul 21 01:36:50.821860 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:50.821027    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" event={"ID":"313cecc1-0db3-4e07-974c-8d6304f7aff9","Type":"ContainerDied","Data":"c9cb2680a9fb1a45ec1eade93f0582eba05d565e1b1a8d869d44a572d9725b7c"}
Jul 21 01:36:50.825054 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:50.825031    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" event={"ID":"70662634-e84b-42db-9617-6d9dc01cc36b","Type":"ContainerStarted","Data":"fdd6415eb8a88246051ddfb5b7f0d2e63cadd1f4270fcfe760b5267b82a7ab78"}
Jul 21 01:36:50.825287 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:50.825274    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:50.825371 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:50.825354    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:50.841095 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:50.841073    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:50.880682 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:50.880633    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q" podStartSLOduration=9.02658698 podStartE2EDuration="27.880620514s" totalImagesPullingTime="18.854033534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:36:50.880507893 +0000 UTC m=+27.725501488" watchObservedRunningTime="2026-07-21 01:36:50.880620514 +0000 UTC m=+27.725614108"
Jul 21 01:36:51.722548 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:51.722515    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:51.722789 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:51.722648    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:51.723027 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:51.723007    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:51.723120 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:51.723098    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:51.723217 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:51.723156    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:51.723264 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:51.723215    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:51.827855 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:51.827820    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:51.842328 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:51.842290    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:36:52.636772 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:52.636613    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tfjtg"]
Jul 21 01:36:52.636948 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:52.636843    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:52.636948 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:52.636928    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:52.639976 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:52.639950    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pz2tk"]
Jul 21 01:36:52.640110 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:52.640036    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:52.640181 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:52.640121    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:52.640618 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:52.640597    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v4dpq"]
Jul 21 01:36:52.640731 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:52.640674    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:52.640790 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:52.640765    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:52.832317 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:52.832229    2568 generic.go:356] "Generic (PLEG): container finished" podID="313cecc1-0db3-4e07-974c-8d6304f7aff9" containerID="d6a6a0e3c6bc776afd6198f6d483733c4fbb609a838b6b7af8d376667a7d0b47" exitCode=0
Jul 21 01:36:52.832671 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:52.832316    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" event={"ID":"313cecc1-0db3-4e07-974c-8d6304f7aff9","Type":"ContainerDied","Data":"d6a6a0e3c6bc776afd6198f6d483733c4fbb609a838b6b7af8d376667a7d0b47"}
Jul 21 01:36:54.721249 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:54.721176    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:54.721249 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:54.721188    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:54.721673 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:54.721281    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:54.721673 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:54.721277    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:54.721673 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:54.721394    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:54.721673 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:54.721450    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:54.838877 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:54.838853    2568 generic.go:356] "Generic (PLEG): container finished" podID="313cecc1-0db3-4e07-974c-8d6304f7aff9" containerID="7e7d7b1bae50e10b32c470c7eaa54e9c1cc47e36560855812f29586b6ef63344" exitCode=0
Jul 21 01:36:54.839029 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:54.838886    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" event={"ID":"313cecc1-0db3-4e07-974c-8d6304f7aff9","Type":"ContainerDied","Data":"7e7d7b1bae50e10b32c470c7eaa54e9c1cc47e36560855812f29586b6ef63344"}
Jul 21 01:36:56.720687 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:56.720450    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:56.721089 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:56.720497    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:56.721089 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:56.720766    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pz2tk" podUID="9fe3eb07-b8c1-4f5d-9773-b6633b6a9230"
Jul 21 01:36:56.721089 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:56.720838    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjtg" podUID="65f3b611-8116-48be-9fcb-60f2fa2cc140"
Jul 21 01:36:56.721089 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:56.720507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:56.721089 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:56.720945    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpq" podUID="8b7586e5-a575-491c-a704-8f4bf097a9bb"
Jul 21 01:36:57.309473 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.309441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:57.309630 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.309550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:57.309630 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:57.309579    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 01:36:57.309630 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:57.309598    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 01:36:57.309630 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:57.309609    2568 projected.go:196] Error preparing data for projected volume kube-api-access-wwdhr for pod openshift-network-diagnostics/network-check-target-tfjtg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:57.309762 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:57.309666    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr podName:65f3b611-8116-48be-9fcb-60f2fa2cc140 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:29.309649421 +0000 UTC m=+66.154643001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwdhr" (UniqueName: "kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr") pod "network-check-target-tfjtg" (UID: "65f3b611-8116-48be-9fcb-60f2fa2cc140") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 01:36:57.309762 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:57.309679    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:57.309762 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:57.309725    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret podName:9fe3eb07-b8c1-4f5d-9773-b6633b6a9230 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:29.309712246 +0000 UTC m=+66.154705820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret") pod "global-pull-secret-syncer-pz2tk" (UID: "9fe3eb07-b8c1-4f5d-9773-b6633b6a9230") : object "kube-system"/"original-pull-secret" not registered
Jul 21 01:36:57.410462 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.410436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:57.410623 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:57.410586    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:57.410674 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:57.410654    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs podName:8b7586e5-a575-491c-a704-8f4bf097a9bb nodeName:}" failed. No retries permitted until 2026-07-21 01:37:29.410633347 +0000 UTC m=+66.255626934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs") pod "network-metrics-daemon-v4dpq" (UID: "8b7586e5-a575-491c-a704-8f4bf097a9bb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 01:36:57.881645 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.881612    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeReady"
Jul 21 01:36:57.882082 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.881761    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 01:36:57.929028 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.929000    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s5sqg"]
Jul 21 01:36:57.953667 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.953607    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9nbrz"]
Jul 21 01:36:57.953790 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.953748    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:57.956005 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.955979    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 01:36:57.956142 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.956076    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 01:36:57.956142 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.956086    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wcxpb\""
Jul 21 01:36:57.967539 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.967520    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5sqg"]
Jul 21 01:36:57.967642 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.967559    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nbrz"]
Jul 21 01:36:57.967642 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.967633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nbrz"
Jul 21 01:36:57.970250 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.970230    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 01:36:57.970380 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.970295    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 01:36:57.970624 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.970606    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wrwpn\""
Jul 21 01:36:57.971065 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:57.971047    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 01:36:58.114817 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.114769    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d33e2be7-7714-42e2-901e-2a0a015905f3-cert\") pod \"ingress-canary-9nbrz\" (UID: \"d33e2be7-7714-42e2-901e-2a0a015905f3\") " pod="openshift-ingress-canary/ingress-canary-9nbrz"
Jul 21 01:36:58.114985 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.114825    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb9c1459-86cb-4bf3-94fa-195a22db4f98-config-volume\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.114985 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.114851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb9c1459-86cb-4bf3-94fa-195a22db4f98-tmp-dir\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.114985 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.114937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6tjx\" (UniqueName: \"kubernetes.io/projected/bb9c1459-86cb-4bf3-94fa-195a22db4f98-kube-api-access-x6tjx\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.115125 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.114986    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjdcg\" (UniqueName: \"kubernetes.io/projected/d33e2be7-7714-42e2-901e-2a0a015905f3-kube-api-access-xjdcg\") pod \"ingress-canary-9nbrz\" (UID: \"d33e2be7-7714-42e2-901e-2a0a015905f3\") " pod="openshift-ingress-canary/ingress-canary-9nbrz"
Jul 21 01:36:58.115125 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.115105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.215630 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.215547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6tjx\" (UniqueName: \"kubernetes.io/projected/bb9c1459-86cb-4bf3-94fa-195a22db4f98-kube-api-access-x6tjx\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.215630 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.215600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjdcg\" (UniqueName: \"kubernetes.io/projected/d33e2be7-7714-42e2-901e-2a0a015905f3-kube-api-access-xjdcg\") pod \"ingress-canary-9nbrz\" (UID: \"d33e2be7-7714-42e2-901e-2a0a015905f3\") " pod="openshift-ingress-canary/ingress-canary-9nbrz"
Jul 21 01:36:58.215841 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.215672    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.215841 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.215747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d33e2be7-7714-42e2-901e-2a0a015905f3-cert\") pod \"ingress-canary-9nbrz\" (UID: \"d33e2be7-7714-42e2-901e-2a0a015905f3\") " pod="openshift-ingress-canary/ingress-canary-9nbrz"
Jul 21 01:36:58.215841 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.215774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb9c1459-86cb-4bf3-94fa-195a22db4f98-config-volume\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.215841 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.215797    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb9c1459-86cb-4bf3-94fa-195a22db4f98-tmp-dir\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.216020 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:58.215885    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:36:58.216020 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:58.215946    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls podName:bb9c1459-86cb-4bf3-94fa-195a22db4f98 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:58.715929345 +0000 UTC m=+35.560922918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls") pod "dns-default-s5sqg" (UID: "bb9c1459-86cb-4bf3-94fa-195a22db4f98") : secret "dns-default-metrics-tls" not found
Jul 21 01:36:58.216159 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.216140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb9c1459-86cb-4bf3-94fa-195a22db4f98-tmp-dir\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.216386 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.216364    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb9c1459-86cb-4bf3-94fa-195a22db4f98-config-volume\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.220341 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.220301    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d33e2be7-7714-42e2-901e-2a0a015905f3-cert\") pod \"ingress-canary-9nbrz\" (UID: \"d33e2be7-7714-42e2-901e-2a0a015905f3\") " pod="openshift-ingress-canary/ingress-canary-9nbrz"
Jul 21 01:36:58.224563 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.224541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6tjx\" (UniqueName: \"kubernetes.io/projected/bb9c1459-86cb-4bf3-94fa-195a22db4f98-kube-api-access-x6tjx\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.224655 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.224624    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjdcg\" (UniqueName: \"kubernetes.io/projected/d33e2be7-7714-42e2-901e-2a0a015905f3-kube-api-access-xjdcg\") pod \"ingress-canary-9nbrz\" (UID: \"d33e2be7-7714-42e2-901e-2a0a015905f3\") " pod="openshift-ingress-canary/ingress-canary-9nbrz"
Jul 21 01:36:58.276577 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.276552    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nbrz"
Jul 21 01:36:58.719784 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.719748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:58.719959 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:58.719925    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:36:58.720015 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:58.720001    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls podName:bb9c1459-86cb-4bf3-94fa-195a22db4f98 nodeName:}" failed. No retries permitted until 2026-07-21 01:36:59.719982006 +0000 UTC m=+36.564975580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls") pod "dns-default-s5sqg" (UID: "bb9c1459-86cb-4bf3-94fa-195a22db4f98") : secret "dns-default-metrics-tls" not found
Jul 21 01:36:58.720411 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.720384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:36:58.720541 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.720425    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:36:58.720541 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.720385    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:36:58.722973 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.722947    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 01:36:58.723098 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.722950    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 01:36:58.723098 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.722954    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 01:36:58.723797 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.723775    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5qdkq\""
Jul 21 01:36:58.723961 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.723801    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8s87n\""
Jul 21 01:36:58.723961 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:58.723895    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 01:36:59.069130 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:59.069103    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nbrz"]
Jul 21 01:36:59.116686 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:36:59.116660    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33e2be7_7714_42e2_901e_2a0a015905f3.slice/crio-a61dc84c0c2916b4aed2a83169415ef24a1e2561dbb544d28a289fca418d784e WatchSource:0}: Error finding container a61dc84c0c2916b4aed2a83169415ef24a1e2561dbb544d28a289fca418d784e: Status 404 returned error can't find the container with id a61dc84c0c2916b4aed2a83169415ef24a1e2561dbb544d28a289fca418d784e
Jul 21 01:36:59.729625 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:59.729434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:36:59.729842 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:59.729550    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:36:59.729842 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:36:59.729756    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls podName:bb9c1459-86cb-4bf3-94fa-195a22db4f98 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:01.729739625 +0000 UTC m=+38.574733208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls") pod "dns-default-s5sqg" (UID: "bb9c1459-86cb-4bf3-94fa-195a22db4f98") : secret "dns-default-metrics-tls" not found
Jul 21 01:36:59.851568 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:59.851521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nbrz" event={"ID":"d33e2be7-7714-42e2-901e-2a0a015905f3","Type":"ContainerStarted","Data":"a61dc84c0c2916b4aed2a83169415ef24a1e2561dbb544d28a289fca418d784e"}
Jul 21 01:36:59.854730 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:59.854699    2568 generic.go:356] "Generic (PLEG): container finished" podID="313cecc1-0db3-4e07-974c-8d6304f7aff9" containerID="f89e7ee2634ae0346a49abdb709ffd08bf43349bd5f6127ca2c43fbaeecaeb35" exitCode=0
Jul 21 01:36:59.854862 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:36:59.854744    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" event={"ID":"313cecc1-0db3-4e07-974c-8d6304f7aff9","Type":"ContainerDied","Data":"f89e7ee2634ae0346a49abdb709ffd08bf43349bd5f6127ca2c43fbaeecaeb35"}
Jul 21 01:37:00.860997 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:00.860966    2568 generic.go:356] "Generic (PLEG): container finished" podID="313cecc1-0db3-4e07-974c-8d6304f7aff9" containerID="cc89c80e6084ad242f2ebe758a2275f886d4e06dcf645a815326b5dc412ee06c" exitCode=0
Jul 21 01:37:00.861445 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:00.861007    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" event={"ID":"313cecc1-0db3-4e07-974c-8d6304f7aff9","Type":"ContainerDied","Data":"cc89c80e6084ad242f2ebe758a2275f886d4e06dcf645a815326b5dc412ee06c"}
Jul 21 01:37:01.745155 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:01.745127    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:37:01.745346 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:01.745225    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:37:01.745346 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:01.745273    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls podName:bb9c1459-86cb-4bf3-94fa-195a22db4f98 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:05.74525962 +0000 UTC m=+42.590253193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls") pod "dns-default-s5sqg" (UID: "bb9c1459-86cb-4bf3-94fa-195a22db4f98") : secret "dns-default-metrics-tls" not found
Jul 21 01:37:01.864191 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:01.864160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nbrz" event={"ID":"d33e2be7-7714-42e2-901e-2a0a015905f3","Type":"ContainerStarted","Data":"018d2986b291033310794ac062848be332b0bcafcbda11740f185a6d51613497"}
Jul 21 01:37:01.867699 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:01.867674    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" event={"ID":"313cecc1-0db3-4e07-974c-8d6304f7aff9","Type":"ContainerStarted","Data":"b3993b7775033ea3d97403064a3a5cd0e2d377e9a17a062a97689cd5b1847f7d"}
Jul 21 01:37:01.880334 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:01.880266    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9nbrz" podStartSLOduration=2.893272786 podStartE2EDuration="4.880250801s" totalImagesPullingTime="1.986978015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:01.879893342 +0000 UTC m=+38.724886959" watchObservedRunningTime="2026-07-21 01:37:01.880250801 +0000 UTC m=+38.725244397"
Jul 21 01:37:01.902023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:01.901984    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d4cf7" podStartSLOduration=9.034575884 podStartE2EDuration="38.901973353s" totalImagesPullingTime="29.867397469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:01.90080156 +0000 UTC m=+38.745795156" watchObservedRunningTime="2026-07-21 01:37:01.901973353 +0000 UTC m=+38.746966948"
Jul 21 01:37:04.760518 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.760346    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7x495"]
Jul 21 01:37:04.766110 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.766092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.768395 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.768369    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5pn52\""
Jul 21 01:37:04.769174 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.769154    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 01:37:04.769174 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.769167    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 01:37:04.769347 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.769192    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 01:37:04.769347 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.769254    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 01:37:04.775981 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.775963    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7x495"]
Jul 21 01:37:04.869163 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.869132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.869338 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.869186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/197fe718-567e-475b-b585-c4d6e42f3e07-data-volume\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.869338 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.869270    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k4qk\" (UniqueName: \"kubernetes.io/projected/197fe718-567e-475b-b585-c4d6e42f3e07-kube-api-access-6k4qk\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.869338 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.869293    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.869446 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.869344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/197fe718-567e-475b-b585-c4d6e42f3e07-crio-socket\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.969995 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.969959    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k4qk\" (UniqueName: \"kubernetes.io/projected/197fe718-567e-475b-b585-c4d6e42f3e07-kube-api-access-6k4qk\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.969995 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.969998    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.970220 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.970033    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/197fe718-567e-475b-b585-c4d6e42f3e07-crio-socket\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.970220 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.970060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.970220 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.970119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/197fe718-567e-475b-b585-c4d6e42f3e07-data-volume\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.970220 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:04.970120    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:04.970220 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:04.970174    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:37:04.970220 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:04.970211    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:05.470192414 +0000 UTC m=+42.315185988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:04.970459 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:04.970245    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:05.470227582 +0000 UTC m=+42.315221155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : configmap "kube-rbac-proxy" not found
Jul 21 01:37:04.970459 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.970259    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/197fe718-567e-475b-b585-c4d6e42f3e07-crio-socket\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.970525 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.970477    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/197fe718-567e-475b-b585-c4d6e42f3e07-data-volume\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:04.981531 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:04.981504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k4qk\" (UniqueName: \"kubernetes.io/projected/197fe718-567e-475b-b585-c4d6e42f3e07-kube-api-access-6k4qk\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:05.277365 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.277334    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5"]
Jul 21 01:37:05.294155 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.294127    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5"]
Jul 21 01:37:05.294274 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.294218    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5"
Jul 21 01:37:05.296495 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.296472    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-g2bgl\""
Jul 21 01:37:05.296495 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.296479    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 01:37:05.296772 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.296757    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 01:37:05.474143 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.474106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8hdl\" (UniqueName: \"kubernetes.io/projected/92bf5747-a01f-4a48-8341-30b72ba29f6b-kube-api-access-r8hdl\") pod \"migrator-7cc9c7ffd7-ngbn5\" (UID: \"92bf5747-a01f-4a48-8341-30b72ba29f6b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5"
Jul 21 01:37:05.474359 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.474168    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:05.474359 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.474220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:05.474359 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:05.474271    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:05.474359 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:05.474304    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:37:05.474359 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:05.474362    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:06.47434285 +0000 UTC m=+43.319336425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:05.474547 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:05.474382    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:06.474371942 +0000 UTC m=+43.319365517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : configmap "kube-rbac-proxy" not found
Jul 21 01:37:05.575388 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.575317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8hdl\" (UniqueName: \"kubernetes.io/projected/92bf5747-a01f-4a48-8341-30b72ba29f6b-kube-api-access-r8hdl\") pod \"migrator-7cc9c7ffd7-ngbn5\" (UID: \"92bf5747-a01f-4a48-8341-30b72ba29f6b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5"
Jul 21 01:37:05.584095 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.584072    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8hdl\" (UniqueName: \"kubernetes.io/projected/92bf5747-a01f-4a48-8341-30b72ba29f6b-kube-api-access-r8hdl\") pod \"migrator-7cc9c7ffd7-ngbn5\" (UID: \"92bf5747-a01f-4a48-8341-30b72ba29f6b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5"
Jul 21 01:37:05.602995 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.602972    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5"
Jul 21 01:37:05.748419 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.748394    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5"]
Jul 21 01:37:05.751437 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:37:05.751415    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92bf5747_a01f_4a48_8341_30b72ba29f6b.slice/crio-be767269937e486bd30258ef4675e9af2953fa54881408cf6f3da661a1a2d00b WatchSource:0}: Error finding container be767269937e486bd30258ef4675e9af2953fa54881408cf6f3da661a1a2d00b: Status 404 returned error can't find the container with id be767269937e486bd30258ef4675e9af2953fa54881408cf6f3da661a1a2d00b
Jul 21 01:37:05.777617 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.777598    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:37:05.777879 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:05.777715    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:37:05.777879 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:05.777758    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls podName:bb9c1459-86cb-4bf3-94fa-195a22db4f98 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:13.777745851 +0000 UTC m=+50.622739424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls") pod "dns-default-s5sqg" (UID: "bb9c1459-86cb-4bf3-94fa-195a22db4f98") : secret "dns-default-metrics-tls" not found
Jul 21 01:37:05.878234 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:05.878207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5" event={"ID":"92bf5747-a01f-4a48-8341-30b72ba29f6b","Type":"ContainerStarted","Data":"be767269937e486bd30258ef4675e9af2953fa54881408cf6f3da661a1a2d00b"}
Jul 21 01:37:06.482085 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:06.482047    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:06.482242 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:06.482135    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:06.482242 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:06.482168    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:37:06.482242 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:06.482218    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:06.482242 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:06.482231    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:08.48221662 +0000 UTC m=+45.327210196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : configmap "kube-rbac-proxy" not found
Jul 21 01:37:06.482434 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:06.482254    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:08.482243533 +0000 UTC m=+45.327237105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:06.744923 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:06.744851    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5w56_9d05c403-0eb3-48c4-8c89-123b9ddcfec0/dns-node-resolver/0.log"
Jul 21 01:37:07.545471 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:07.545437    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dn56p_90673ea3-b76b-4942-8087-b7e19186ea4c/node-ca/0.log"
Jul 21 01:37:07.883857 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:07.883824    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5" event={"ID":"92bf5747-a01f-4a48-8341-30b72ba29f6b","Type":"ContainerStarted","Data":"fc163e64a0218c65fcc1dc85be23485c912840325a46c59d70f323667c839fdd"}
Jul 21 01:37:07.883983 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:07.883888    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5" event={"ID":"92bf5747-a01f-4a48-8341-30b72ba29f6b","Type":"ContainerStarted","Data":"7f2c33ea5c810eb7a8c6844f895b5177201d535a07e5618a9a6e0ddd9ea13ceb"}
Jul 21 01:37:07.904349 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:07.904284    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-ngbn5" podStartSLOduration=1.034662957 podStartE2EDuration="2.904268464s" totalImagesPullingTime="1.869605507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:07.903498036 +0000 UTC m=+44.748491634" watchObservedRunningTime="2026-07-21 01:37:07.904268464 +0000 UTC m=+44.749262058"
Jul 21 01:37:08.347267 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:08.347237    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nbrz_d33e2be7-7714-42e2-901e-2a0a015905f3/serve-healthcheck-canary/0.log"
Jul 21 01:37:08.495247 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:08.495213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:08.495440 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:08.495254    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:08.495440 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:08.495373    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:08.495513 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:08.495442    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:12.49542674 +0000 UTC m=+49.340420313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:08.495513 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:08.495376    2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 01:37:08.495513 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:08.495507    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:12.495495828 +0000 UTC m=+49.340489406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : configmap "kube-rbac-proxy" not found
Jul 21 01:37:12.522187 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:12.522152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:12.522187 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:12.522194    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:12.522635 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:12.522304    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:12.522635 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:12.522401    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls podName:197fe718-567e-475b-b585-c4d6e42f3e07 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:20.522382079 +0000 UTC m=+57.367375675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7x495" (UID: "197fe718-567e-475b-b585-c4d6e42f3e07") : secret "insights-runtime-extractor-tls" not found
Jul 21 01:37:12.522742 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:12.522726    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/197fe718-567e-475b-b585-c4d6e42f3e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:13.832091 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:13.832058    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:37:13.832474 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:13.832178    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 01:37:13.832474 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:37:13.832233    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls podName:bb9c1459-86cb-4bf3-94fa-195a22db4f98 nodeName:}" failed. No retries permitted until 2026-07-21 01:37:29.832219358 +0000 UTC m=+66.677212931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls") pod "dns-default-s5sqg" (UID: "bb9c1459-86cb-4bf3-94fa-195a22db4f98") : secret "dns-default-metrics-tls" not found
Jul 21 01:37:20.579010 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:20.578971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:20.581154 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:20.581136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/197fe718-567e-475b-b585-c4d6e42f3e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x495\" (UID: \"197fe718-567e-475b-b585-c4d6e42f3e07\") " pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:20.675783 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:20.675761    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7x495"
Jul 21 01:37:20.823390 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:20.823361    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7x495"]
Jul 21 01:37:20.826233 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:37:20.826205    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197fe718_567e_475b_b585_c4d6e42f3e07.slice/crio-bcfc2d3ca61485a77a9275e9407c9bce5a6307eac911982b37a329e5300a82c0 WatchSource:0}: Error finding container bcfc2d3ca61485a77a9275e9407c9bce5a6307eac911982b37a329e5300a82c0: Status 404 returned error can't find the container with id bcfc2d3ca61485a77a9275e9407c9bce5a6307eac911982b37a329e5300a82c0
Jul 21 01:37:20.913503 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:20.913471    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7x495" event={"ID":"197fe718-567e-475b-b585-c4d6e42f3e07","Type":"ContainerStarted","Data":"bcfc2d3ca61485a77a9275e9407c9bce5a6307eac911982b37a329e5300a82c0"}
Jul 21 01:37:23.844677 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:23.844646    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jn6q"
Jul 21 01:37:25.927757 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:25.927722    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7x495" event={"ID":"197fe718-567e-475b-b585-c4d6e42f3e07","Type":"ContainerStarted","Data":"7f97091ccf3f2bc341323cff389bb30695b27b9930cfc65c63fc7fc10eb72051"}
Jul 21 01:37:29.342326 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.342167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:37:29.342326 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.342299    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:37:29.344700 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.344678    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 01:37:29.344829 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.344699    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 01:37:29.354992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.354940    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fe3eb07-b8c1-4f5d-9773-b6633b6a9230-original-pull-secret\") pod \"global-pull-secret-syncer-pz2tk\" (UID: \"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230\") " pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:37:29.355147 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.355123    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 01:37:29.365681 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.365662    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwdhr\" (UniqueName: \"kubernetes.io/projected/65f3b611-8116-48be-9fcb-60f2fa2cc140-kube-api-access-wwdhr\") pod \"network-check-target-tfjtg\" (UID: \"65f3b611-8116-48be-9fcb-60f2fa2cc140\") " pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:37:29.442791 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.442762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:37:29.445167 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.445151    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 01:37:29.455284 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.455264    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7586e5-a575-491c-a704-8f4bf097a9bb-metrics-certs\") pod \"network-metrics-daemon-v4dpq\" (UID: \"8b7586e5-a575-491c-a704-8f4bf097a9bb\") " pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:37:29.634929 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.634899    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5qdkq\""
Jul 21 01:37:29.640538 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.640516    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8s87n\""
Jul 21 01:37:29.642372 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.642353    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpq"
Jul 21 01:37:29.643561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.643541    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pz2tk"
Jul 21 01:37:29.649236 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.649217    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:37:29.806299 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.806251    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pz2tk"]
Jul 21 01:37:29.810834 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:37:29.810802    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe3eb07_b8c1_4f5d_9773_b6633b6a9230.slice/crio-d459ce6a463e47f7f880034c9d115b0459d1ca33b1a80c8da4c389f3deb9a534 WatchSource:0}: Error finding container d459ce6a463e47f7f880034c9d115b0459d1ca33b1a80c8da4c389f3deb9a534: Status 404 returned error can't find the container with id d459ce6a463e47f7f880034c9d115b0459d1ca33b1a80c8da4c389f3deb9a534
Jul 21 01:37:29.845553 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.845531    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:37:29.847897 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.847874    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb9c1459-86cb-4bf3-94fa-195a22db4f98-metrics-tls\") pod \"dns-default-s5sqg\" (UID: \"bb9c1459-86cb-4bf3-94fa-195a22db4f98\") " pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:37:29.919400 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.919323    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"]
Jul 21 01:37:29.921828 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.921808    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"
Jul 21 01:37:29.926737 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.926716    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 01:37:29.926997 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.926963    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 01:37:29.927809 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.927786    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6v2xb\""
Jul 21 01:37:29.927900 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.927833    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 01:37:29.927900 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.927836    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 01:37:29.940898 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.940750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7x495" event={"ID":"197fe718-567e-475b-b585-c4d6e42f3e07","Type":"ContainerStarted","Data":"c6ef42a96c2e4fbf16b03c22633715e228eaa955948b2487a4a8a477f3261e22"}
Jul 21 01:37:29.942020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.942000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pz2tk" event={"ID":"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230","Type":"ContainerStarted","Data":"d459ce6a463e47f7f880034c9d115b0459d1ca33b1a80c8da4c389f3deb9a534"}
Jul 21 01:37:29.946437 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.946411    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84hn8\" (UniqueName: \"kubernetes.io/projected/faf5cb55-adf2-4f3b-b5aa-c67390475630-kube-api-access-84hn8\") pod \"managed-serviceaccount-addon-agent-f94484f9b-hx669\" (UID: \"faf5cb55-adf2-4f3b-b5aa-c67390475630\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"
Jul 21 01:37:29.946546 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.946463    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/faf5cb55-adf2-4f3b-b5aa-c67390475630-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f94484f9b-hx669\" (UID: \"faf5cb55-adf2-4f3b-b5aa-c67390475630\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"
Jul 21 01:37:29.947835 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.947813    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"]
Jul 21 01:37:29.949811 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.949794    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:29.953868 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.953778    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 01:37:29.953984 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.953876    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 01:37:29.953984 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.953937    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 01:37:29.953984 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.953966    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"]
Jul 21 01:37:29.954184 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.954168    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 01:37:29.988497 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:29.988471    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"]
Jul 21 01:37:30.047541 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.047511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/faf5cb55-adf2-4f3b-b5aa-c67390475630-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f94484f9b-hx669\" (UID: \"faf5cb55-adf2-4f3b-b5aa-c67390475630\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"
Jul 21 01:37:30.048011 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.047561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.048097 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.048079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6172bdf8-7b96-43df-922d-42ba3e52be0d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.048155 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.048135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qnqm\" (UniqueName: \"kubernetes.io/projected/6172bdf8-7b96-43df-922d-42ba3e52be0d-kube-api-access-4qnqm\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.048208 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.048174    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84hn8\" (UniqueName: \"kubernetes.io/projected/faf5cb55-adf2-4f3b-b5aa-c67390475630-kube-api-access-84hn8\") pod \"managed-serviceaccount-addon-agent-f94484f9b-hx669\" (UID: \"faf5cb55-adf2-4f3b-b5aa-c67390475630\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"
Jul 21 01:37:30.048208 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.048198    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-hub\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.048325 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.048220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.048325 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.048247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-ca\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.049186 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.049130    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tfjtg"]
Jul 21 01:37:30.050163 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.050143    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v4dpq"]
Jul 21 01:37:30.050963 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.050943    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/faf5cb55-adf2-4f3b-b5aa-c67390475630-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f94484f9b-hx669\" (UID: \"faf5cb55-adf2-4f3b-b5aa-c67390475630\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"
Jul 21 01:37:30.052386 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:37:30.052355    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f3b611_8116_48be_9fcb_60f2fa2cc140.slice/crio-8fcf6948e05087213ab5b2aac6c0258961a96b9fb08158ec2a81c57635267a04 WatchSource:0}: Error finding container 8fcf6948e05087213ab5b2aac6c0258961a96b9fb08158ec2a81c57635267a04: Status 404 returned error can't find the container with id 8fcf6948e05087213ab5b2aac6c0258961a96b9fb08158ec2a81c57635267a04
Jul 21 01:37:30.053143 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:37:30.053028    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7586e5_a575_491c_a704_8f4bf097a9bb.slice/crio-e2d27ea7676c8a770e867f58e9427b5ce913de5c38ee267dcc510012ead7084e WatchSource:0}: Error finding container e2d27ea7676c8a770e867f58e9427b5ce913de5c38ee267dcc510012ead7084e: Status 404 returned error can't find the container with id e2d27ea7676c8a770e867f58e9427b5ce913de5c38ee267dcc510012ead7084e
Jul 21 01:37:30.067131 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.067110    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84hn8\" (UniqueName: \"kubernetes.io/projected/faf5cb55-adf2-4f3b-b5aa-c67390475630-kube-api-access-84hn8\") pod \"managed-serviceaccount-addon-agent-f94484f9b-hx669\" (UID: \"faf5cb55-adf2-4f3b-b5aa-c67390475630\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"
Jul 21 01:37:30.067753 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.067736    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wcxpb\""
Jul 21 01:37:30.075214 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.075184    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:37:30.149259 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.149228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.149423 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.149293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6172bdf8-7b96-43df-922d-42ba3e52be0d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.149423 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.149351    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qnqm\" (UniqueName: \"kubernetes.io/projected/6172bdf8-7b96-43df-922d-42ba3e52be0d-kube-api-access-4qnqm\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.149423 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.149384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-hub\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.149423 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.149411    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.149633 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.149437    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-ca\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.150343 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.150294    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6172bdf8-7b96-43df-922d-42ba3e52be0d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.152375 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.152351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.152815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.152789    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-ca\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.152925 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.152803    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.153030 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.153007    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6172bdf8-7b96-43df-922d-42ba3e52be0d-hub\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.159961 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.159920    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qnqm\" (UniqueName: \"kubernetes.io/projected/6172bdf8-7b96-43df-922d-42ba3e52be0d-kube-api-access-4qnqm\") pod \"cluster-proxy-proxy-agent-79c77f56f7-42dz8\" (UID: \"6172bdf8-7b96-43df-922d-42ba3e52be0d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.212187 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.212114    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5sqg"]
Jul 21 01:37:30.215326 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:37:30.215284    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9c1459_86cb_4bf3_94fa_195a22db4f98.slice/crio-f302992fdeb6c5e88ccd661c8c3853ae359ca9ed7f2f05081b41877ef4089d81 WatchSource:0}: Error finding container f302992fdeb6c5e88ccd661c8c3853ae359ca9ed7f2f05081b41877ef4089d81: Status 404 returned error can't find the container with id f302992fdeb6c5e88ccd661c8c3853ae359ca9ed7f2f05081b41877ef4089d81
Jul 21 01:37:30.255334 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.255291    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"
Jul 21 01:37:30.264389 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.264362    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"
Jul 21 01:37:30.419910 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.419848    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669"]
Jul 21 01:37:30.423926 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:37:30.423892    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaf5cb55_adf2_4f3b_b5aa_c67390475630.slice/crio-803f3c35b5c84eab248b4a7cc2772ce9c3f52c6e492bce95e7f086ff6a5ffe6b WatchSource:0}: Error finding container 803f3c35b5c84eab248b4a7cc2772ce9c3f52c6e492bce95e7f086ff6a5ffe6b: Status 404 returned error can't find the container with id 803f3c35b5c84eab248b4a7cc2772ce9c3f52c6e492bce95e7f086ff6a5ffe6b
Jul 21 01:37:30.446265 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.446230    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8"]
Jul 21 01:37:30.449605 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:37:30.449566    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6172bdf8_7b96_43df_922d_42ba3e52be0d.slice/crio-c8269c064f5e23af367855dddb97ea088b537c4d11c41c540493e588e99dc385 WatchSource:0}: Error finding container c8269c064f5e23af367855dddb97ea088b537c4d11c41c540493e588e99dc385: Status 404 returned error can't find the container with id c8269c064f5e23af367855dddb97ea088b537c4d11c41c540493e588e99dc385
Jul 21 01:37:30.951640 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.951599    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5sqg" event={"ID":"bb9c1459-86cb-4bf3-94fa-195a22db4f98","Type":"ContainerStarted","Data":"f302992fdeb6c5e88ccd661c8c3853ae359ca9ed7f2f05081b41877ef4089d81"}
Jul 21 01:37:30.953501 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.953471    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tfjtg" event={"ID":"65f3b611-8116-48be-9fcb-60f2fa2cc140","Type":"ContainerStarted","Data":"8fcf6948e05087213ab5b2aac6c0258961a96b9fb08158ec2a81c57635267a04"}
Jul 21 01:37:30.955554 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.955486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4dpq" event={"ID":"8b7586e5-a575-491c-a704-8f4bf097a9bb","Type":"ContainerStarted","Data":"e2d27ea7676c8a770e867f58e9427b5ce913de5c38ee267dcc510012ead7084e"}
Jul 21 01:37:30.957077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.957052    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8" event={"ID":"6172bdf8-7b96-43df-922d-42ba3e52be0d","Type":"ContainerStarted","Data":"c8269c064f5e23af367855dddb97ea088b537c4d11c41c540493e588e99dc385"}
Jul 21 01:37:30.958384 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:30.958343    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669" event={"ID":"faf5cb55-adf2-4f3b-b5aa-c67390475630","Type":"ContainerStarted","Data":"803f3c35b5c84eab248b4a7cc2772ce9c3f52c6e492bce95e7f086ff6a5ffe6b"}
Jul 21 01:37:39.991397 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.991362    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5sqg" event={"ID":"bb9c1459-86cb-4bf3-94fa-195a22db4f98","Type":"ContainerStarted","Data":"75eb435c8b1baa7851b14eeea28a2d7e821342fd4982a0236ae0f6ddf5904e6e"}
Jul 21 01:37:39.991891 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.991419    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5sqg" event={"ID":"bb9c1459-86cb-4bf3-94fa-195a22db4f98","Type":"ContainerStarted","Data":"3ee739c4600efabd1314c73b411490f0be15024396e6819911f7cd79bc0b1922"}
Jul 21 01:37:39.991891 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.991446    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:37:39.992881 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.992858    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tfjtg" event={"ID":"65f3b611-8116-48be-9fcb-60f2fa2cc140","Type":"ContainerStarted","Data":"d0e9677a0cc4f9ff0ff98bf44ec82dcdd3615db58f0db7eaff7be288698de9e1"}
Jul 21 01:37:39.992966 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.992949    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:37:39.994501 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.994480    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4dpq" event={"ID":"8b7586e5-a575-491c-a704-8f4bf097a9bb","Type":"ContainerStarted","Data":"aba69bdd0a1172cf7ecacc4459dac2aa971beb8d328ec7e0f6c71b135475f8db"}
Jul 21 01:37:39.994596 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.994526    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4dpq" event={"ID":"8b7586e5-a575-491c-a704-8f4bf097a9bb","Type":"ContainerStarted","Data":"9e1ccb8b21b7f445c6b841555c0e0fd2ec26bf38d1309570e59974012c40e704"}
Jul 21 01:37:39.996323 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.996285    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7x495" event={"ID":"197fe718-567e-475b-b585-c4d6e42f3e07","Type":"ContainerStarted","Data":"8d1297cc0892248ffb5595a8832e7bfef3bf7e814605b7c47e7fe39d18d5ff15"}
Jul 21 01:37:39.998088 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.998068    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8" event={"ID":"6172bdf8-7b96-43df-922d-42ba3e52be0d","Type":"ContainerStarted","Data":"3e367eb2d86caed0cb605fdd9e8b729c83a0b9a9b5a056ec0f2349eb12186326"}
Jul 21 01:37:39.998173 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.998102    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8" event={"ID":"6172bdf8-7b96-43df-922d-42ba3e52be0d","Type":"ContainerStarted","Data":"4d7a172b903c107e6e87adc50a118a37dcc194f11b9a1ae638a560514d85ccfa"}
Jul 21 01:37:39.998173 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.998117    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8" event={"ID":"6172bdf8-7b96-43df-922d-42ba3e52be0d","Type":"ContainerStarted","Data":"12ac1125e7be4e75668aa447a3f815cb6141c762a54cbf29cb0e7c13bb19da8b"}
Jul 21 01:37:39.999333 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:39.999298    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pz2tk" event={"ID":"9fe3eb07-b8c1-4f5d-9773-b6633b6a9230","Type":"ContainerStarted","Data":"81ddd5596c1760d50c61dc4dd46816c273a4a2184cd7309601a458b5309f995d"}
Jul 21 01:37:40.000547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:40.000529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669" event={"ID":"faf5cb55-adf2-4f3b-b5aa-c67390475630","Type":"ContainerStarted","Data":"7dd40e98a152c86ffcd069f4fee6199c813056601bfb43c07fc28359266e6379"}
Jul 21 01:37:40.012847 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:40.012649    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s5sqg" podStartSLOduration=33.9847291 podStartE2EDuration="43.01263317s" totalImagesPullingTime="9.02790407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:40.010980295 +0000 UTC m=+76.855973901" watchObservedRunningTime="2026-07-21 01:37:40.01263317 +0000 UTC m=+76.857626766"
Jul 21 01:37:40.044668 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:40.044626    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tfjtg" podStartSLOduration=67.853887163 podStartE2EDuration="1m17.044610387s" totalImagesPullingTime="9.190723224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:40.044238527 +0000 UTC m=+76.889232121" watchObservedRunningTime="2026-07-21 01:37:40.044610387 +0000 UTC m=+76.889603983"
Jul 21 01:37:40.045256 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:40.045227    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pz2tk" podStartSLOduration=67.615081613 podStartE2EDuration="1m17.045218612s" totalImagesPullingTime="9.430136999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:40.028925557 +0000 UTC m=+76.873919152" watchObservedRunningTime="2026-07-21 01:37:40.045218612 +0000 UTC m=+76.890212184"
Jul 21 01:37:40.060256 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:40.060216    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v4dpq" podStartSLOduration=67.909878835 podStartE2EDuration="1m17.060205389s" totalImagesPullingTime="9.150326554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:40.059357424 +0000 UTC m=+76.904351019" watchObservedRunningTime="2026-07-21 01:37:40.060205389 +0000 UTC m=+76.905198984"
Jul 21 01:37:40.077779 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:40.077743    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7x495" podStartSLOduration=17.793742678 podStartE2EDuration="36.077730986s" totalImagesPullingTime="18.283988308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:37:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:40.076901976 +0000 UTC m=+76.921895593" watchObservedRunningTime="2026-07-21 01:37:40.077730986 +0000 UTC m=+76.922724582"
Jul 21 01:37:40.092004 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:40.091970    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f94484f9b-hx669" podStartSLOduration=2.2641065510000002 podStartE2EDuration="11.091958898s" totalImagesPullingTime="8.827852347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:40.090683952 +0000 UTC m=+76.935677548" watchObservedRunningTime="2026-07-21 01:37:40.091958898 +0000 UTC m=+76.936952492"
Jul 21 01:37:40.109093 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:40.109063    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c77f56f7-42dz8" podStartSLOduration=2.286426005 podStartE2EDuration="11.109055514s" totalImagesPullingTime="8.822629509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:37:40.108537432 +0000 UTC m=+76.953531055" watchObservedRunningTime="2026-07-21 01:37:40.109055514 +0000 UTC m=+76.954049108"
Jul 21 01:37:50.006876 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:37:50.006744    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s5sqg"
Jul 21 01:38:01.245609 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.245576    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-645zh"]
Jul 21 01:38:01.274702 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.274677    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.277653 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.277632    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 01:38:01.277774 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.277637    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 01:38:01.277774 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.277745    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 01:38:01.278142 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.278129    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 01:38:01.278851 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.278838    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 01:38:01.278910 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.278870    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 01:38:01.278979 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.278963    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wpz6w\""
Jul 21 01:38:01.357630 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.357630 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-sys\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.357786 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357649    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-root\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.357786 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.357786 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357689    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e0bc03c-28bf-4499-9360-90e17e9f35b8-metrics-client-ca\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.357786 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.357786 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357736    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkmgk\" (UniqueName: \"kubernetes.io/projected/9e0bc03c-28bf-4499-9360-90e17e9f35b8-kube-api-access-tkmgk\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.357786 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-wtmp\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.357786 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.357788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-textfile\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458500 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458473    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-textfile\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458524    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-sys\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-root\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e0bc03c-28bf-4499-9360-90e17e9f35b8-metrics-client-ca\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458620    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-sys\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmgk\" (UniqueName: \"kubernetes.io/projected/9e0bc03c-28bf-4499-9360-90e17e9f35b8-kube-api-access-tkmgk\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.458663 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458636    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-root\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.459073 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:38:01.458698    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 01:38:01.459073 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-wtmp\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.459073 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:38:01.458766    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls podName:9e0bc03c-28bf-4499-9360-90e17e9f35b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:38:01.958744694 +0000 UTC m=+98.803738272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls") pod "node-exporter-645zh" (UID: "9e0bc03c-28bf-4499-9360-90e17e9f35b8") : secret "node-exporter-tls" not found
Jul 21 01:38:01.459073 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-wtmp\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.459073 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.458882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-textfile\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.459234 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.459209    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.459268 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.459216    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e0bc03c-28bf-4499-9360-90e17e9f35b8-metrics-client-ca\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.460902 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.460882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.466657 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.466637    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkmgk\" (UniqueName: \"kubernetes.io/projected/9e0bc03c-28bf-4499-9360-90e17e9f35b8-kube-api-access-tkmgk\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.963576 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:01.963540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:01.963746 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:38:01.963659    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 01:38:01.963746 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:38:01.963712    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls podName:9e0bc03c-28bf-4499-9360-90e17e9f35b8 nodeName:}" failed. No retries permitted until 2026-07-21 01:38:02.96369772 +0000 UTC m=+99.808691296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls") pod "node-exporter-645zh" (UID: "9e0bc03c-28bf-4499-9360-90e17e9f35b8") : secret "node-exporter-tls" not found
Jul 21 01:38:02.971325 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:02.971269    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:02.973537 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:02.973516    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e0bc03c-28bf-4499-9360-90e17e9f35b8-node-exporter-tls\") pod \"node-exporter-645zh\" (UID: \"9e0bc03c-28bf-4499-9360-90e17e9f35b8\") " pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:03.083476 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:03.083451    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-645zh"
Jul 21 01:38:03.093875 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:38:03.093843    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0bc03c_28bf_4499_9360_90e17e9f35b8.slice/crio-91f2ae46eab0ed41ba9064640fcf95455156809e25cabb4c64981fbe2d0f2340 WatchSource:0}: Error finding container 91f2ae46eab0ed41ba9064640fcf95455156809e25cabb4c64981fbe2d0f2340: Status 404 returned error can't find the container with id 91f2ae46eab0ed41ba9064640fcf95455156809e25cabb4c64981fbe2d0f2340
Jul 21 01:38:04.075075 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:04.075042    2568 generic.go:356] "Generic (PLEG): container finished" podID="9e0bc03c-28bf-4499-9360-90e17e9f35b8" containerID="7243ff374e9c9b3206bc198554a7d9ebb7e94e12c697650f696e25ef9ce4d3e2" exitCode=0
Jul 21 01:38:04.075380 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:04.075116    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-645zh" event={"ID":"9e0bc03c-28bf-4499-9360-90e17e9f35b8","Type":"ContainerDied","Data":"7243ff374e9c9b3206bc198554a7d9ebb7e94e12c697650f696e25ef9ce4d3e2"}
Jul 21 01:38:04.075380 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:04.075170    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-645zh" event={"ID":"9e0bc03c-28bf-4499-9360-90e17e9f35b8","Type":"ContainerStarted","Data":"91f2ae46eab0ed41ba9064640fcf95455156809e25cabb4c64981fbe2d0f2340"}
Jul 21 01:38:05.080718 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:05.080685    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-645zh" event={"ID":"9e0bc03c-28bf-4499-9360-90e17e9f35b8","Type":"ContainerStarted","Data":"3ee374fb1c717e3106d77e302b52f3211ae532a05faa7ddf2a647f2bfc3d08b7"}
Jul 21 01:38:05.081094 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:05.080745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-645zh" event={"ID":"9e0bc03c-28bf-4499-9360-90e17e9f35b8","Type":"ContainerStarted","Data":"d6b3754bec1e5682242e7b8307e95198b69cc337de465c2a6e74cc8115510053"}
Jul 21 01:38:05.103064 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:05.103023    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-645zh" podStartSLOduration=3.244173489 podStartE2EDuration="4.1030082s" totalImagesPullingTime="798.04757ms" totalInitContainerRuntime="60.787141ms" isStatefulPod=true podCreationTimestamp="2026-07-21 01:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:38:05.101708648 +0000 UTC m=+101.946702243" watchObservedRunningTime="2026-07-21 01:38:05.1030082 +0000 UTC m=+101.948001801"
Jul 21 01:38:11.007192 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:11.007164    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tfjtg"
Jul 21 01:38:24.389002 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:38:24.388972    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nbrz_d33e2be7-7714-42e2-901e-2a0a015905f3/serve-healthcheck-canary/0.log"
Jul 21 01:39:58.359907 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.359872    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"]
Jul 21 01:39:58.361848 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.361832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.363996 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.363977    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jnnvd\""
Jul 21 01:39:58.364113 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.363980    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 01:39:58.364851 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.364838    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 01:39:58.371626 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.371608    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"]
Jul 21 01:39:58.417534 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.417513    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6m82\" (UniqueName: \"kubernetes.io/projected/8ee5d28d-590b-480f-b7dd-f218e60e72b6-kube-api-access-f6m82\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.417636 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.417547    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.417636 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.417564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.518124 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.518098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.518124 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.518126    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.518363 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.518188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6m82\" (UniqueName: \"kubernetes.io/projected/8ee5d28d-590b-480f-b7dd-f218e60e72b6-kube-api-access-f6m82\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.518608 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.518574    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.518680 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.518611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.525623 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.525602    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6m82\" (UniqueName: \"kubernetes.io/projected/8ee5d28d-590b-480f-b7dd-f218e60e72b6-kube-api-access-f6m82\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.670937 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.670907    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:39:58.792233 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:58.791932    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"]
Jul 21 01:39:58.794973 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:39:58.794947    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee5d28d_590b_480f_b7dd_f218e60e72b6.slice/crio-9caf58f22dc77336089f96bafaf8b6fa8aebb8c46a96b0fd6314c58a2cb98f6d WatchSource:0}: Error finding container 9caf58f22dc77336089f96bafaf8b6fa8aebb8c46a96b0fd6314c58a2cb98f6d: Status 404 returned error can't find the container with id 9caf58f22dc77336089f96bafaf8b6fa8aebb8c46a96b0fd6314c58a2cb98f6d
Jul 21 01:39:59.431671 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:39:59.431636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6" event={"ID":"8ee5d28d-590b-480f-b7dd-f218e60e72b6","Type":"ContainerStarted","Data":"9caf58f22dc77336089f96bafaf8b6fa8aebb8c46a96b0fd6314c58a2cb98f6d"}
Jul 21 01:40:05.453359 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:05.453303    2568 generic.go:356] "Generic (PLEG): container finished" podID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerID="45615b75f8c696f393bc3d3fd3449c07759541fa8f2b2b020bbbb3c19a03649a" exitCode=0
Jul 21 01:40:05.453789 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:05.453388    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6" event={"ID":"8ee5d28d-590b-480f-b7dd-f218e60e72b6","Type":"ContainerDied","Data":"45615b75f8c696f393bc3d3fd3449c07759541fa8f2b2b020bbbb3c19a03649a"}
Jul 21 01:40:08.464144 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:08.464060    2568 generic.go:356] "Generic (PLEG): container finished" podID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerID="e4ba79b749fb40678e8c74ca3a45302007978bb797e237d2ca52c859899140f0" exitCode=0
Jul 21 01:40:08.464144 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:08.464117    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6" event={"ID":"8ee5d28d-590b-480f-b7dd-f218e60e72b6","Type":"ContainerDied","Data":"e4ba79b749fb40678e8c74ca3a45302007978bb797e237d2ca52c859899140f0"}
Jul 21 01:40:16.492989 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:16.492957    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6" event={"ID":"8ee5d28d-590b-480f-b7dd-f218e60e72b6","Type":"ContainerStarted","Data":"7ec48925c3915801d2b441032e4fedefb9228ae6766f2fc42d78ce56dfd8176b"}
Jul 21 01:40:16.510366 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:16.510323    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6" podStartSLOduration=1.8777538950000001 podStartE2EDuration="18.510288842s" totalImagesPullingTime="16.632534947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:39:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:40:16.509782986 +0000 UTC m=+233.354776627" watchObservedRunningTime="2026-07-21 01:40:16.510288842 +0000 UTC m=+233.355282436"
Jul 21 01:40:17.497984 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:17.497953    2568 generic.go:356] "Generic (PLEG): container finished" podID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerID="7ec48925c3915801d2b441032e4fedefb9228ae6766f2fc42d78ce56dfd8176b" exitCode=0
Jul 21 01:40:17.498381 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:17.498000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6" event={"ID":"8ee5d28d-590b-480f-b7dd-f218e60e72b6","Type":"ContainerDied","Data":"7ec48925c3915801d2b441032e4fedefb9228ae6766f2fc42d78ce56dfd8176b"}
Jul 21 01:40:18.620141 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.620120    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:40:18.656902 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.656884    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-bundle\") pod \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") "
Jul 21 01:40:18.657005 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.656915    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6m82\" (UniqueName: \"kubernetes.io/projected/8ee5d28d-590b-480f-b7dd-f218e60e72b6-kube-api-access-f6m82\") pod \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") "
Jul 21 01:40:18.657005 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.656935    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-util\") pod \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\" (UID: \"8ee5d28d-590b-480f-b7dd-f218e60e72b6\") "
Jul 21 01:40:18.657565 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.657536    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-bundle" (OuterVolumeSpecName: "bundle") pod "8ee5d28d-590b-480f-b7dd-f218e60e72b6" (UID: "8ee5d28d-590b-480f-b7dd-f218e60e72b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:40:18.658893 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.658873    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee5d28d-590b-480f-b7dd-f218e60e72b6-kube-api-access-f6m82" (OuterVolumeSpecName: "kube-api-access-f6m82") pod "8ee5d28d-590b-480f-b7dd-f218e60e72b6" (UID: "8ee5d28d-590b-480f-b7dd-f218e60e72b6"). InnerVolumeSpecName "kube-api-access-f6m82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:40:18.661666 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.661645    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-util" (OuterVolumeSpecName: "util") pod "8ee5d28d-590b-480f-b7dd-f218e60e72b6" (UID: "8ee5d28d-590b-480f-b7dd-f218e60e72b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:40:18.757899 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.757830    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:18.757899 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.757851    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6m82\" (UniqueName: \"kubernetes.io/projected/8ee5d28d-590b-480f-b7dd-f218e60e72b6-kube-api-access-f6m82\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:18.757899 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:18.757860    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ee5d28d-590b-480f-b7dd-f218e60e72b6-util\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:19.506025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:19.505988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6" event={"ID":"8ee5d28d-590b-480f-b7dd-f218e60e72b6","Type":"ContainerDied","Data":"9caf58f22dc77336089f96bafaf8b6fa8aebb8c46a96b0fd6314c58a2cb98f6d"}
Jul 21 01:40:19.506025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:19.506015    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dkqr6"
Jul 21 01:40:19.506215 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:19.506040    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9caf58f22dc77336089f96bafaf8b6fa8aebb8c46a96b0fd6314c58a2cb98f6d"
Jul 21 01:40:26.300659 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.300624    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"]
Jul 21 01:40:26.301023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.300847    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerName="extract"
Jul 21 01:40:26.301023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.300857    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerName="extract"
Jul 21 01:40:26.301023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.300893    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerName="util"
Jul 21 01:40:26.301023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.300898    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerName="util"
Jul 21 01:40:26.301023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.300904    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerName="pull"
Jul 21 01:40:26.301023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.300909    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerName="pull"
Jul 21 01:40:26.301023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.300949    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ee5d28d-590b-480f-b7dd-f218e60e72b6" containerName="extract"
Jul 21 01:40:26.305286 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.305269    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"
Jul 21 01:40:26.308113 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.308097    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:40:26.308258 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.308242    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 01:40:26.308375 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.308358    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8sj44\""
Jul 21 01:40:26.316555 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.316532    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"]
Jul 21 01:40:26.406284 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.406260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxj5f\" (UniqueName: \"kubernetes.io/projected/eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee-kube-api-access-cxj5f\") pod \"cert-manager-operator-controller-manager-55c444bf86-5j7pm\" (UID: \"eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"
Jul 21 01:40:26.406412 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.406293    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5j7pm\" (UID: \"eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"
Jul 21 01:40:26.507174 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.507150    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxj5f\" (UniqueName: \"kubernetes.io/projected/eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee-kube-api-access-cxj5f\") pod \"cert-manager-operator-controller-manager-55c444bf86-5j7pm\" (UID: \"eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"
Jul 21 01:40:26.507260 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.507182    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5j7pm\" (UID: \"eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"
Jul 21 01:40:26.507596 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.507581    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5j7pm\" (UID: \"eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"
Jul 21 01:40:26.516152 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.516132    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxj5f\" (UniqueName: \"kubernetes.io/projected/eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee-kube-api-access-cxj5f\") pod \"cert-manager-operator-controller-manager-55c444bf86-5j7pm\" (UID: \"eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"
Jul 21 01:40:26.614024 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.613989    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"
Jul 21 01:40:26.739449 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:26.739423    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm"]
Jul 21 01:40:26.742442 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:40:26.742419    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb20d7b3_f617_4b82_8600_2bbd8dd4d1ee.slice/crio-ed65b1d200d001161579d2cfd8087438b24f7cbb0a895c70e76af6453769092b WatchSource:0}: Error finding container ed65b1d200d001161579d2cfd8087438b24f7cbb0a895c70e76af6453769092b: Status 404 returned error can't find the container with id ed65b1d200d001161579d2cfd8087438b24f7cbb0a895c70e76af6453769092b
Jul 21 01:40:27.534963 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:27.534929    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm" event={"ID":"eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee","Type":"ContainerStarted","Data":"ed65b1d200d001161579d2cfd8087438b24f7cbb0a895c70e76af6453769092b"}
Jul 21 01:40:28.540396 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:28.540291    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm" event={"ID":"eb20d7b3-f617-4b82-8600-2bbd8dd4d1ee","Type":"ContainerStarted","Data":"165c188587777afebf88b4b3ae4459b56ca8ef75e88b3cd5d95227a2a218c247"}
Jul 21 01:40:28.561733 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:28.561683    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5j7pm" podStartSLOduration=1.055102261 podStartE2EDuration="2.561668881s" totalImagesPullingTime="1.50656662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:40:28.559899681 +0000 UTC m=+245.404893277" watchObservedRunningTime="2026-07-21 01:40:28.561668881 +0000 UTC m=+245.406662475"
Jul 21 01:40:29.867815 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.867783    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"]
Jul 21 01:40:29.869923 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.869907    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:29.872241 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.872216    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 01:40:29.872359 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.872229    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 01:40:29.873188 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.873174    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jnnvd\""
Jul 21 01:40:29.881150 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.881129    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"]
Jul 21 01:40:29.931166 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.931138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:29.931289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.931173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9pbz\" (UniqueName: \"kubernetes.io/projected/cc7627e5-c237-45b9-bba0-b0373e18c675-kube-api-access-t9pbz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:29.931289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:29.931250    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:30.031739 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.031712    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:30.031848 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.031752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:30.031848 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.031775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9pbz\" (UniqueName: \"kubernetes.io/projected/cc7627e5-c237-45b9-bba0-b0373e18c675-kube-api-access-t9pbz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:30.032077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.032059    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:30.032138 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.032122    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:30.040402 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.040382    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9pbz\" (UniqueName: \"kubernetes.io/projected/cc7627e5-c237-45b9-bba0-b0373e18c675-kube-api-access-t9pbz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:30.178263 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.178188    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:30.299072 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.299021    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"]
Jul 21 01:40:30.301468 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:40:30.301440    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7627e5_c237_45b9_bba0_b0373e18c675.slice/crio-9dd597a5c3e6b852878606098730f9a9d5e023d0ea6d2295745e7570a0de280d WatchSource:0}: Error finding container 9dd597a5c3e6b852878606098730f9a9d5e023d0ea6d2295745e7570a0de280d: Status 404 returned error can't find the container with id 9dd597a5c3e6b852878606098730f9a9d5e023d0ea6d2295745e7570a0de280d
Jul 21 01:40:30.548562 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.548481    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerID="1bf055960054f173729b635d11ec5282467efb5b6adb2bbb52da4bba39b8bb10" exitCode=0
Jul 21 01:40:30.548704 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.548561    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx" event={"ID":"cc7627e5-c237-45b9-bba0-b0373e18c675","Type":"ContainerDied","Data":"1bf055960054f173729b635d11ec5282467efb5b6adb2bbb52da4bba39b8bb10"}
Jul 21 01:40:30.548704 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:30.548610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx" event={"ID":"cc7627e5-c237-45b9-bba0-b0373e18c675","Type":"ContainerStarted","Data":"9dd597a5c3e6b852878606098730f9a9d5e023d0ea6d2295745e7570a0de280d"}
Jul 21 01:40:33.561147 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:33.561109    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerID="9f9b4b7bf965f23eb49287092513cf669b1c6514dadd8cc01b56b77215c326b3" exitCode=0
Jul 21 01:40:33.561555 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:33.561191    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx" event={"ID":"cc7627e5-c237-45b9-bba0-b0373e18c675","Type":"ContainerDied","Data":"9f9b4b7bf965f23eb49287092513cf669b1c6514dadd8cc01b56b77215c326b3"}
Jul 21 01:40:34.566595 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:34.566565    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerID="73743e1cf34d305df22df2766bb079d2388900bc3019cdd32289cdd03e88d66c" exitCode=0
Jul 21 01:40:34.566979 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:34.566604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx" event={"ID":"cc7627e5-c237-45b9-bba0-b0373e18c675","Type":"ContainerDied","Data":"73743e1cf34d305df22df2766bb079d2388900bc3019cdd32289cdd03e88d66c"}
Jul 21 01:40:35.698830 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.698809    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:35.773488 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.773464    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-util\") pod \"cc7627e5-c237-45b9-bba0-b0373e18c675\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") "
Jul 21 01:40:35.773612 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.773511    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9pbz\" (UniqueName: \"kubernetes.io/projected/cc7627e5-c237-45b9-bba0-b0373e18c675-kube-api-access-t9pbz\") pod \"cc7627e5-c237-45b9-bba0-b0373e18c675\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") "
Jul 21 01:40:35.773612 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.773537    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-bundle\") pod \"cc7627e5-c237-45b9-bba0-b0373e18c675\" (UID: \"cc7627e5-c237-45b9-bba0-b0373e18c675\") "
Jul 21 01:40:35.773980 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.773952    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-bundle" (OuterVolumeSpecName: "bundle") pod "cc7627e5-c237-45b9-bba0-b0373e18c675" (UID: "cc7627e5-c237-45b9-bba0-b0373e18c675"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:40:35.775506 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.775484    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc7627e5-c237-45b9-bba0-b0373e18c675-kube-api-access-t9pbz" (OuterVolumeSpecName: "kube-api-access-t9pbz") pod "cc7627e5-c237-45b9-bba0-b0373e18c675" (UID: "cc7627e5-c237-45b9-bba0-b0373e18c675"). InnerVolumeSpecName "kube-api-access-t9pbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:40:35.777929 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.777908    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-util" (OuterVolumeSpecName: "util") pod "cc7627e5-c237-45b9-bba0-b0373e18c675" (UID: "cc7627e5-c237-45b9-bba0-b0373e18c675"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:40:35.874366 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.874332    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-util\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:35.874366 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.874365    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9pbz\" (UniqueName: \"kubernetes.io/projected/cc7627e5-c237-45b9-bba0-b0373e18c675-kube-api-access-t9pbz\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:35.874366 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:35.874375    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc7627e5-c237-45b9-bba0-b0373e18c675-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:36.261891 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.261818    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"]
Jul 21 01:40:36.262056 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.262045    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerName="util"
Jul 21 01:40:36.262109 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.262058    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerName="util"
Jul 21 01:40:36.262109 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.262068    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerName="extract"
Jul 21 01:40:36.262109 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.262074    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerName="extract"
Jul 21 01:40:36.262109 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.262081    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerName="pull"
Jul 21 01:40:36.262109 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.262087    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerName="pull"
Jul 21 01:40:36.262271 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.262129    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc7627e5-c237-45b9-bba0-b0373e18c675" containerName="extract"
Jul 21 01:40:36.265344 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.265329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"
Jul 21 01:40:36.267906 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.267888    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 01:40:36.268888 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.268873    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lmskn\""
Jul 21 01:40:36.268945 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.268882    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 01:40:36.278527 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.278506    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"]
Jul 21 01:40:36.378199 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.378166    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8z58\" (UniqueName: \"kubernetes.io/projected/cbfd4c17-2357-40f2-9f22-0ce3559e1e39-kube-api-access-s8z58\") pod \"cert-manager-cainjector-559cdd8c87-m6pt7\" (UID: \"cbfd4c17-2357-40f2-9f22-0ce3559e1e39\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"
Jul 21 01:40:36.378199 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.378198    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbfd4c17-2357-40f2-9f22-0ce3559e1e39-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6pt7\" (UID: \"cbfd4c17-2357-40f2-9f22-0ce3559e1e39\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"
Jul 21 01:40:36.478579 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.478542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8z58\" (UniqueName: \"kubernetes.io/projected/cbfd4c17-2357-40f2-9f22-0ce3559e1e39-kube-api-access-s8z58\") pod \"cert-manager-cainjector-559cdd8c87-m6pt7\" (UID: \"cbfd4c17-2357-40f2-9f22-0ce3559e1e39\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"
Jul 21 01:40:36.478579 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.478579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbfd4c17-2357-40f2-9f22-0ce3559e1e39-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6pt7\" (UID: \"cbfd4c17-2357-40f2-9f22-0ce3559e1e39\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"
Jul 21 01:40:36.487177 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.487142    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbfd4c17-2357-40f2-9f22-0ce3559e1e39-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6pt7\" (UID: \"cbfd4c17-2357-40f2-9f22-0ce3559e1e39\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"
Jul 21 01:40:36.487291 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.487195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8z58\" (UniqueName: \"kubernetes.io/projected/cbfd4c17-2357-40f2-9f22-0ce3559e1e39-kube-api-access-s8z58\") pod \"cert-manager-cainjector-559cdd8c87-m6pt7\" (UID: \"cbfd4c17-2357-40f2-9f22-0ce3559e1e39\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"
Jul 21 01:40:36.573507 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.573434    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"
Jul 21 01:40:36.574962 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.574938    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx" event={"ID":"cc7627e5-c237-45b9-bba0-b0373e18c675","Type":"ContainerDied","Data":"9dd597a5c3e6b852878606098730f9a9d5e023d0ea6d2295745e7570a0de280d"}
Jul 21 01:40:36.575052 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.574973    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f24hvx"
Jul 21 01:40:36.575097 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.574979    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9dd597a5c3e6b852878606098730f9a9d5e023d0ea6d2295745e7570a0de280d"
Jul 21 01:40:36.696849 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:36.696825    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7"]
Jul 21 01:40:36.699025 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:40:36.699000    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbfd4c17_2357_40f2_9f22_0ce3559e1e39.slice/crio-759c8a513bf0645be40214fee21f398d656937cda514d070f5e0f6fc678ce9d2 WatchSource:0}: Error finding container 759c8a513bf0645be40214fee21f398d656937cda514d070f5e0f6fc678ce9d2: Status 404 returned error can't find the container with id 759c8a513bf0645be40214fee21f398d656937cda514d070f5e0f6fc678ce9d2
Jul 21 01:40:37.580056 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:37.580016    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7" event={"ID":"cbfd4c17-2357-40f2-9f22-0ce3559e1e39","Type":"ContainerStarted","Data":"759c8a513bf0645be40214fee21f398d656937cda514d070f5e0f6fc678ce9d2"}
Jul 21 01:40:39.588492 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:39.588452    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7" event={"ID":"cbfd4c17-2357-40f2-9f22-0ce3559e1e39","Type":"ContainerStarted","Data":"821be62105d2910e03cffe91a34ce0fa7dd9ffbcbd0c79fd61f5f55d2105a8e0"}
Jul 21 01:40:39.603877 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:39.603835    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6pt7" podStartSLOduration=1.293327002 podStartE2EDuration="3.603822424s" totalImagesPullingTime="2.310495422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:40:39.602712428 +0000 UTC m=+256.447706023" watchObservedRunningTime="2026-07-21 01:40:39.603822424 +0000 UTC m=+256.448816018"
Jul 21 01:40:46.075086 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.075010    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"]
Jul 21 01:40:46.078092 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.078075    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.080212 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.080193    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 01:40:46.080298 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.080220    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 01:40:46.080929 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.080916    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jnnvd\""
Jul 21 01:40:46.089375 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.089358    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"]
Jul 21 01:40:46.158397 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.158367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp556\" (UniqueName: \"kubernetes.io/projected/d0cacd44-1e1c-4197-8dec-4592d9500078-kube-api-access-pp556\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.158506 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.158411    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.158506 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.158466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.259650 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.259620    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp556\" (UniqueName: \"kubernetes.io/projected/d0cacd44-1e1c-4197-8dec-4592d9500078-kube-api-access-pp556\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.259795 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.259657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.259795 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.259677    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.260011 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.259991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.260059 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.260038    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.267515 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.267490    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp556\" (UniqueName: \"kubernetes.io/projected/d0cacd44-1e1c-4197-8dec-4592d9500078-kube-api-access-pp556\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.386731 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.386712    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:46.505696 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.505666    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"]
Jul 21 01:40:46.508171 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:40:46.508145    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cacd44_1e1c_4197_8dec_4592d9500078.slice/crio-358ccef9d38f37f64d6436a352b9f4801778e5bdc93de369e8769ccf4fe0c879 WatchSource:0}: Error finding container 358ccef9d38f37f64d6436a352b9f4801778e5bdc93de369e8769ccf4fe0c879: Status 404 returned error can't find the container with id 358ccef9d38f37f64d6436a352b9f4801778e5bdc93de369e8769ccf4fe0c879
Jul 21 01:40:46.614574 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.614546    2568 generic.go:356] "Generic (PLEG): container finished" podID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerID="ced3884e184556c2027be32a83109b9e531f4396f5a8c39c5ba1297158d94f67" exitCode=0
Jul 21 01:40:46.614683 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.614598    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb" event={"ID":"d0cacd44-1e1c-4197-8dec-4592d9500078","Type":"ContainerDied","Data":"ced3884e184556c2027be32a83109b9e531f4396f5a8c39c5ba1297158d94f67"}
Jul 21 01:40:46.614683 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:46.614633    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb" event={"ID":"d0cacd44-1e1c-4197-8dec-4592d9500078","Type":"ContainerStarted","Data":"358ccef9d38f37f64d6436a352b9f4801778e5bdc93de369e8769ccf4fe0c879"}
Jul 21 01:40:47.619708 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:47.619676    2568 generic.go:356] "Generic (PLEG): container finished" podID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerID="e85006973bd33bf47032c78a6e0790e7eab342467fda3bf19cc1e53beef793e2" exitCode=0
Jul 21 01:40:47.620063 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:47.619745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb" event={"ID":"d0cacd44-1e1c-4197-8dec-4592d9500078","Type":"ContainerDied","Data":"e85006973bd33bf47032c78a6e0790e7eab342467fda3bf19cc1e53beef793e2"}
Jul 21 01:40:48.625712 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:48.625677    2568 generic.go:356] "Generic (PLEG): container finished" podID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerID="2a6edda210a13929c65b5ad855f854494e7cf7514868102a7e79e5795957368a" exitCode=0
Jul 21 01:40:48.626099 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:48.625747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb" event={"ID":"d0cacd44-1e1c-4197-8dec-4592d9500078","Type":"ContainerDied","Data":"2a6edda210a13929c65b5ad855f854494e7cf7514868102a7e79e5795957368a"}
Jul 21 01:40:49.773253 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.773222    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:49.884121 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.884047    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-bundle\") pod \"d0cacd44-1e1c-4197-8dec-4592d9500078\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") "
Jul 21 01:40:49.884121 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.884097    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-util\") pod \"d0cacd44-1e1c-4197-8dec-4592d9500078\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") "
Jul 21 01:40:49.884288 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.884133    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp556\" (UniqueName: \"kubernetes.io/projected/d0cacd44-1e1c-4197-8dec-4592d9500078-kube-api-access-pp556\") pod \"d0cacd44-1e1c-4197-8dec-4592d9500078\" (UID: \"d0cacd44-1e1c-4197-8dec-4592d9500078\") "
Jul 21 01:40:49.884781 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.884754    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-bundle" (OuterVolumeSpecName: "bundle") pod "d0cacd44-1e1c-4197-8dec-4592d9500078" (UID: "d0cacd44-1e1c-4197-8dec-4592d9500078"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:40:49.886090 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.886069    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0cacd44-1e1c-4197-8dec-4592d9500078-kube-api-access-pp556" (OuterVolumeSpecName: "kube-api-access-pp556") pod "d0cacd44-1e1c-4197-8dec-4592d9500078" (UID: "d0cacd44-1e1c-4197-8dec-4592d9500078"). InnerVolumeSpecName "kube-api-access-pp556". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:40:49.889392 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.889361    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-util" (OuterVolumeSpecName: "util") pod "d0cacd44-1e1c-4197-8dec-4592d9500078" (UID: "d0cacd44-1e1c-4197-8dec-4592d9500078"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:40:49.984694 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.984666    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:49.984694 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.984687    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0cacd44-1e1c-4197-8dec-4592d9500078-util\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:49.984694 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:49.984695    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp556\" (UniqueName: \"kubernetes.io/projected/d0cacd44-1e1c-4197-8dec-4592d9500078-kube-api-access-pp556\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:40:50.634698 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:50.634665    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb" event={"ID":"d0cacd44-1e1c-4197-8dec-4592d9500078","Type":"ContainerDied","Data":"358ccef9d38f37f64d6436a352b9f4801778e5bdc93de369e8769ccf4fe0c879"}
Jul 21 01:40:50.634698 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:50.634699    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwwbmb"
Jul 21 01:40:50.634893 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:50.634712    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="358ccef9d38f37f64d6436a352b9f4801778e5bdc93de369e8769ccf4fe0c879"
Jul 21 01:40:59.829545 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.829513    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"]
Jul 21 01:40:59.830020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.829743    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerName="pull"
Jul 21 01:40:59.830020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.829756    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerName="pull"
Jul 21 01:40:59.830020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.829771    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerName="extract"
Jul 21 01:40:59.830020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.829777    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerName="extract"
Jul 21 01:40:59.830020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.829785    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerName="util"
Jul 21 01:40:59.830020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.829790    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerName="util"
Jul 21 01:40:59.830020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.829838    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0cacd44-1e1c-4197-8dec-4592d9500078" containerName="extract"
Jul 21 01:40:59.833234 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.833205    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:40:59.836182 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.836160    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wdvgf\""
Jul 21 01:40:59.836339 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.836161    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 01:40:59.836576 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.836551    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 01:40:59.836696 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.836607    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 01:40:59.836696 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.836660    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 01:40:59.845761 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.845740    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"]
Jul 21 01:40:59.946605 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.946575    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06191940-2bce-416c-abe3-8a3eeb36a148-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:40:59.946722 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.946612    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06191940-2bce-416c-abe3-8a3eeb36a148-tmp\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:40:59.946722 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.946638    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06191940-2bce-416c-abe3-8a3eeb36a148-manifests\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:40:59.946722 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.946692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v6nk\" (UniqueName: \"kubernetes.io/projected/06191940-2bce-416c-abe3-8a3eeb36a148-kube-api-access-2v6nk\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:40:59.946722 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:40:59.946713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06191940-2bce-416c-abe3-8a3eeb36a148-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.047542 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.047511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06191940-2bce-416c-abe3-8a3eeb36a148-manifests\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.047711 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.047562    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v6nk\" (UniqueName: \"kubernetes.io/projected/06191940-2bce-416c-abe3-8a3eeb36a148-kube-api-access-2v6nk\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.047711 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.047599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06191940-2bce-416c-abe3-8a3eeb36a148-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.047711 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.047628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06191940-2bce-416c-abe3-8a3eeb36a148-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.047711 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.047657    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06191940-2bce-416c-abe3-8a3eeb36a148-tmp\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.047970 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.047952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06191940-2bce-416c-abe3-8a3eeb36a148-manifests\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.049953 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.049913    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06191940-2bce-416c-abe3-8a3eeb36a148-tmp\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.050085 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.050054    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06191940-2bce-416c-abe3-8a3eeb36a148-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.050134 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.050085    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06191940-2bce-416c-abe3-8a3eeb36a148-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.062957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.062931    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v6nk\" (UniqueName: \"kubernetes.io/projected/06191940-2bce-416c-abe3-8a3eeb36a148-kube-api-access-2v6nk\") pod \"opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm\" (UID: \"06191940-2bce-416c-abe3-8a3eeb36a148\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.143934 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.143916    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:00.279044 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.279024    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"]
Jul 21 01:41:00.281429 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:41:00.281403    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06191940_2bce_416c_abe3_8a3eeb36a148.slice/crio-fe66b2f817c2f9e2e3c15899d526ddeb57b0ce427548e6ea70325aaf70925d6c WatchSource:0}: Error finding container fe66b2f817c2f9e2e3c15899d526ddeb57b0ce427548e6ea70325aaf70925d6c: Status 404 returned error can't find the container with id fe66b2f817c2f9e2e3c15899d526ddeb57b0ce427548e6ea70325aaf70925d6c
Jul 21 01:41:00.674034 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:00.674001    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm" event={"ID":"06191940-2bce-416c-abe3-8a3eeb36a148","Type":"ContainerStarted","Data":"fe66b2f817c2f9e2e3c15899d526ddeb57b0ce427548e6ea70325aaf70925d6c"}
Jul 21 01:41:03.687494 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:03.687469    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm" event={"ID":"06191940-2bce-416c-abe3-8a3eeb36a148","Type":"ContainerStarted","Data":"54d6c252659e51343342254136857a0935bff7f197da8c4fd795d6c121e2785a"}
Jul 21 01:41:05.697235 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:05.697206    2568 generic.go:356] "Generic (PLEG): container finished" podID="06191940-2bce-416c-abe3-8a3eeb36a148" containerID="54d6c252659e51343342254136857a0935bff7f197da8c4fd795d6c121e2785a" exitCode=0
Jul 21 01:41:05.697628 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:05.697287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm" event={"ID":"06191940-2bce-416c-abe3-8a3eeb36a148","Type":"ContainerDied","Data":"54d6c252659e51343342254136857a0935bff7f197da8c4fd795d6c121e2785a"}
Jul 21 01:41:06.703304 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:06.703270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm" event={"ID":"06191940-2bce-416c-abe3-8a3eeb36a148","Type":"ContainerStarted","Data":"31d72572f2e651f6804c8c14df48068c8f88b71119a2cb90206ce8be00e052a6"}
Jul 21 01:41:06.703721 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:06.703529    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:06.724906 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:06.724866    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm" podStartSLOduration=3.087410637 podStartE2EDuration="7.724852106s" totalImagesPullingTime="3.567268119s" totalInitContainerRuntime="1.07017335s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:40:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:41:06.722565439 +0000 UTC m=+283.567559034" watchObservedRunningTime="2026-07-21 01:41:06.724852106 +0000 UTC m=+283.569845772"
Jul 21 01:41:17.710144 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:17.710107    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm"
Jul 21 01:41:18.747717 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.747687    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"]
Jul 21 01:41:18.750827 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.750809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.754290 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.754261    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 01:41:18.754290 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.754286    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 01:41:18.754470 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.754356    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 01:41:18.754470 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.754392    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n59fd\""
Jul 21 01:41:18.754470 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.754403    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 01:41:18.754586 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.754484    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 01:41:18.761463 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.761440    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"]
Jul 21 01:41:18.876025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.875993    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37bdaf16-515a-4c28-aaba-6f803174d6b9-metrics-cert\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.876025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.876028    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37bdaf16-515a-4c28-aaba-6f803174d6b9-cert\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.876201 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.876053    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzvn\" (UniqueName: \"kubernetes.io/projected/37bdaf16-515a-4c28-aaba-6f803174d6b9-kube-api-access-4kzvn\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.876201 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.876100    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37bdaf16-515a-4c28-aaba-6f803174d6b9-manager-config\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.977358 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.977326    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37bdaf16-515a-4c28-aaba-6f803174d6b9-manager-config\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.977485 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.977380    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37bdaf16-515a-4c28-aaba-6f803174d6b9-metrics-cert\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.977485 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.977408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37bdaf16-515a-4c28-aaba-6f803174d6b9-cert\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.977485 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.977444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzvn\" (UniqueName: \"kubernetes.io/projected/37bdaf16-515a-4c28-aaba-6f803174d6b9-kube-api-access-4kzvn\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.978010 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.977988    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/37bdaf16-515a-4c28-aaba-6f803174d6b9-manager-config\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.979785 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.979758    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37bdaf16-515a-4c28-aaba-6f803174d6b9-cert\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.979945 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.979926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/37bdaf16-515a-4c28-aaba-6f803174d6b9-metrics-cert\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:18.991719 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:18.991694    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzvn\" (UniqueName: \"kubernetes.io/projected/37bdaf16-515a-4c28-aaba-6f803174d6b9-kube-api-access-4kzvn\") pod \"lws-controller-manager-95964d979-pzkxn\" (UID: \"37bdaf16-515a-4c28-aaba-6f803174d6b9\") " pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:19.059858 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:19.059804    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:19.210526 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:19.210456    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"]
Jul 21 01:41:19.213083 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:41:19.213055    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37bdaf16_515a_4c28_aaba_6f803174d6b9.slice/crio-68db15d20fc6f1b3913b5494dd5cf33bdf99cc01d7eca921631599e0b7c74f8d WatchSource:0}: Error finding container 68db15d20fc6f1b3913b5494dd5cf33bdf99cc01d7eca921631599e0b7c74f8d: Status 404 returned error can't find the container with id 68db15d20fc6f1b3913b5494dd5cf33bdf99cc01d7eca921631599e0b7c74f8d
Jul 21 01:41:19.753536 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:19.753501    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn" event={"ID":"37bdaf16-515a-4c28-aaba-6f803174d6b9","Type":"ContainerStarted","Data":"68db15d20fc6f1b3913b5494dd5cf33bdf99cc01d7eca921631599e0b7c74f8d"}
Jul 21 01:41:20.758531 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:20.758494    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn" event={"ID":"37bdaf16-515a-4c28-aaba-6f803174d6b9","Type":"ContainerStarted","Data":"827f08735e9b5c111196ee27324492c67e488598e8fa0b9f260991d850a64a0b"}
Jul 21 01:41:20.759025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:20.758633    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:20.789628 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:20.789540    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn" podStartSLOduration=1.470094582 podStartE2EDuration="2.789523086s" totalImagesPullingTime="1.319428504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:41:20.787731986 +0000 UTC m=+297.632725601" watchObservedRunningTime="2026-07-21 01:41:20.789523086 +0000 UTC m=+297.634516680"
Jul 21 01:41:23.576135 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:23.576108    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 01:41:27.295836 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.295799    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"]
Jul 21 01:41:27.298929 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.298913    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.301375 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.301350    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vpwf5\""
Jul 21 01:41:27.301539 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.301383    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 01:41:27.301539 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.301388    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 01:41:27.301539 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.301416    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 01:41:27.311424 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.311403    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"]
Jul 21 01:41:27.353094 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.353209 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353101    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.353209 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353124    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.353209 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353141    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.353209 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.353386 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353250    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa2d4440-3482-47d3-9a6a-e48499a19c49-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.353386 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353281    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.353386 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8cgm\" (UniqueName: \"kubernetes.io/projected/aa2d4440-3482-47d3-9a6a-e48499a19c49-kube-api-access-f8cgm\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.353386 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.353337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454486 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454442    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa2d4440-3482-47d3-9a6a-e48499a19c49-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454486 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454492    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454697 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8cgm\" (UniqueName: \"kubernetes.io/projected/aa2d4440-3482-47d3-9a6a-e48499a19c49-kube-api-access-f8cgm\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454697 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454697 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454579    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454697 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454602    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454697 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454626    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454917 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454767    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.454917 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.454811    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.455036 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.455014    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.455094 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.455048    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.455248 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.455224    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.455339 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.455245    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa2d4440-3482-47d3-9a6a-e48499a19c49-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.455339 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.455274    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.456900 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.456878    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.457255 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.457237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.462420 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.462400    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa2d4440-3482-47d3-9a6a-e48499a19c49-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.462606 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.462583    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8cgm\" (UniqueName: \"kubernetes.io/projected/aa2d4440-3482-47d3-9a6a-e48499a19c49-kube-api-access-f8cgm\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678tbmj7\" (UID: \"aa2d4440-3482-47d3-9a6a-e48499a19c49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.608957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.608878    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:27.735141 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.735115    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"]
Jul 21 01:41:27.737941 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:41:27.737909    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2d4440_3482_47d3_9a6a_e48499a19c49.slice/crio-39de7ee243f2b2a5a449c9ab4c4f390f2959c84b507ac2a8eab44cb64de502d9 WatchSource:0}: Error finding container 39de7ee243f2b2a5a449c9ab4c4f390f2959c84b507ac2a8eab44cb64de502d9: Status 404 returned error can't find the container with id 39de7ee243f2b2a5a449c9ab4c4f390f2959c84b507ac2a8eab44cb64de502d9
Jul 21 01:41:27.739858 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.739838    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:41:27.784261 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:27.784231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7" event={"ID":"aa2d4440-3482-47d3-9a6a-e48499a19c49","Type":"ContainerStarted","Data":"39de7ee243f2b2a5a449c9ab4c4f390f2959c84b507ac2a8eab44cb64de502d9"}
Jul 21 01:41:29.100527 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.100491    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"]
Jul 21 01:41:29.103809 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.103782    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.106399 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.106374    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 01:41:29.106540 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.106380    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 01:41:29.106540 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.106388    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gkmq8\""
Jul 21 01:41:29.106540 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.106481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 01:41:29.119972 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.119950    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"]
Jul 21 01:41:29.167100 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.167072    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.167243 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.167108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.167243 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.167144    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4txg\" (UniqueName: \"kubernetes.io/projected/db456430-6275-4aad-b6a6-a56f3686230d-kube-api-access-v4txg\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.167243 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.167226    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db456430-6275-4aad-b6a6-a56f3686230d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.167386 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.167268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db456430-6275-4aad-b6a6-a56f3686230d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.167386 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.167294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.167386 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.167359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db456430-6275-4aad-b6a6-a56f3686230d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.268705 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.268673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db456430-6275-4aad-b6a6-a56f3686230d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.268879 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.268723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db456430-6275-4aad-b6a6-a56f3686230d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.268879 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.268748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.268879 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.268774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db456430-6275-4aad-b6a6-a56f3686230d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.268879 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.268823    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.268879 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.268856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.269139 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.268895    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4txg\" (UniqueName: \"kubernetes.io/projected/db456430-6275-4aad-b6a6-a56f3686230d-kube-api-access-v4txg\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.269615 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.269557    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/db456430-6275-4aad-b6a6-a56f3686230d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.271379 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.271333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/db456430-6275-4aad-b6a6-a56f3686230d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.271713 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.271656    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.271713 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.271699    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.271939 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.271809    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/db456430-6275-4aad-b6a6-a56f3686230d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.285754 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.285730    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db456430-6275-4aad-b6a6-a56f3686230d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.286598 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.286577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4txg\" (UniqueName: \"kubernetes.io/projected/db456430-6275-4aad-b6a6-a56f3686230d-kube-api-access-v4txg\") pod \"istiod-openshift-gateway-94bb8fbfd-lqltt\" (UID: \"db456430-6275-4aad-b6a6-a56f3686230d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:29.414787 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:29.414752    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:30.209781 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:30.209727    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 01:41:30.210097 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:30.209835    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 01:41:30.210097 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:30.209879    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 01:41:30.303228 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:30.303193    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"]
Jul 21 01:41:30.305274 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:41:30.305234    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb456430_6275_4aad_b6a6_a56f3686230d.slice/crio-805662acab2d6289c236b9e7f03ec7120c1f3207c093db26150834430b4b1a26 WatchSource:0}: Error finding container 805662acab2d6289c236b9e7f03ec7120c1f3207c093db26150834430b4b1a26: Status 404 returned error can't find the container with id 805662acab2d6289c236b9e7f03ec7120c1f3207c093db26150834430b4b1a26
Jul 21 01:41:30.801638 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:30.801593    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt" event={"ID":"db456430-6275-4aad-b6a6-a56f3686230d","Type":"ContainerStarted","Data":"805662acab2d6289c236b9e7f03ec7120c1f3207c093db26150834430b4b1a26"}
Jul 21 01:41:30.803254 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:30.803234    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7" event={"ID":"aa2d4440-3482-47d3-9a6a-e48499a19c49","Type":"ContainerStarted","Data":"1df9ec2e6574502a96b6ee3ea43ca8214543867ca44a2e49c1f1901b828f62c7"}
Jul 21 01:41:30.828414 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:30.828360    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7" podStartSLOduration=1.358879444 podStartE2EDuration="3.828340548s" totalImagesPullingTime="2.469461104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:41:30.827525397 +0000 UTC m=+307.672518993" watchObservedRunningTime="2026-07-21 01:41:30.828340548 +0000 UTC m=+307.673334142"
Jul 21 01:41:31.609395 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:31.609354    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:31.614751 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:31.614730    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:31.764765 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:31.764733    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-95964d979-pzkxn"
Jul 21 01:41:31.807740 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:31.807711    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:31.808920 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:31.808901    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678tbmj7"
Jul 21 01:41:32.492827 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:32.492796    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 01:41:32.492949 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:32.492854    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 01:41:32.813202 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:32.813121    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt" event={"ID":"db456430-6275-4aad-b6a6-a56f3686230d","Type":"ContainerStarted","Data":"77c7ed5b9a3555e3610f8744923521dd5af751b99e6ef2d5fd20ffe27459c456"}
Jul 21 01:41:32.813575 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:32.813338    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:41:32.834410 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:32.834359    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt" podStartSLOduration=1.649742275 podStartE2EDuration="3.834344979s" totalImagesPullingTime="2.184602704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:41:32.832824468 +0000 UTC m=+309.677818089" watchObservedRunningTime="2026-07-21 01:41:32.834344979 +0000 UTC m=+309.679338574"
Jul 21 01:41:33.818506 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:41:33.818481    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lqltt"
Jul 21 01:42:36.682594 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.682561    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"]
Jul 21 01:42:36.684721 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.684705    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.687089 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.687069    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 01:42:36.687192 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.687102    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 01:42:36.687237 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.687190    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7xkt9\""
Jul 21 01:42:36.691510 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.691264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfgfs\" (UniqueName: \"kubernetes.io/projected/7445dcf0-a628-4066-adae-6523eb0200c9-kube-api-access-cfgfs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.691695 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.691669    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.691778 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.691726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.692821 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.692803    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"]
Jul 21 01:42:36.792638 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.792607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.792809 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.792649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.792809 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.792685    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfgfs\" (UniqueName: \"kubernetes.io/projected/7445dcf0-a628-4066-adae-6523eb0200c9-kube-api-access-cfgfs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.793107 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.793089    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.793172 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.793091    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.799997 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.799976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfgfs\" (UniqueName: \"kubernetes.io/projected/7445dcf0-a628-4066-adae-6523eb0200c9-kube-api-access-cfgfs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:36.994206 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:36.994126    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:37.090181 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.090144    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"]
Jul 21 01:42:37.093170 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.093147    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.101558 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.101531    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"]
Jul 21 01:42:37.123077 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.123053    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"]
Jul 21 01:42:37.126187 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:42:37.126166    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7445dcf0_a628_4066_adae_6523eb0200c9.slice/crio-91ddd55c8499d5b56471d3b5ff293132bb74bc691ccf06c3a476254200ec43c1 WatchSource:0}: Error finding container 91ddd55c8499d5b56471d3b5ff293132bb74bc691ccf06c3a476254200ec43c1: Status 404 returned error can't find the container with id 91ddd55c8499d5b56471d3b5ff293132bb74bc691ccf06c3a476254200ec43c1
Jul 21 01:42:37.196514 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.196493    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh8m4\" (UniqueName: \"kubernetes.io/projected/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-kube-api-access-vh8m4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.196620 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.196563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.196620 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.196596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.297914 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.297836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.297914 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.297879    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh8m4\" (UniqueName: \"kubernetes.io/projected/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-kube-api-access-vh8m4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.298088 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.297937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.298234 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.298217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.298234 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.298227    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.305532 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.305509    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh8m4\" (UniqueName: \"kubernetes.io/projected/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-kube-api-access-vh8m4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.405657 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.405628    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:37.483624 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.483102    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"]
Jul 21 01:42:37.486050 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.486029    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.494852 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.494793    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"]
Jul 21 01:42:37.505348 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.501648    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.505348 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.501713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h9p8\" (UniqueName: \"kubernetes.io/projected/c07cf9ca-4da8-4bde-96d0-4c428d5da979-kube-api-access-9h9p8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.505348 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.501749    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.534113 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.534085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"]
Jul 21 01:42:37.536975 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:42:37.536951    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87ca6cd_2c35_4086_ba41_bce02fa0e2a3.slice/crio-f7d28b9eee6d9b29448e80e90abeb73d4a939fbfece40b500ac50d77cf23b7fd WatchSource:0}: Error finding container f7d28b9eee6d9b29448e80e90abeb73d4a939fbfece40b500ac50d77cf23b7fd: Status 404 returned error can't find the container with id f7d28b9eee6d9b29448e80e90abeb73d4a939fbfece40b500ac50d77cf23b7fd
Jul 21 01:42:37.602407 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.602383    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.602548 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.602424    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9p8\" (UniqueName: \"kubernetes.io/projected/c07cf9ca-4da8-4bde-96d0-4c428d5da979-kube-api-access-9h9p8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.602548 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.602453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.602753 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.602728    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.602817 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.602791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.614664 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.614639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h9p8\" (UniqueName: \"kubernetes.io/projected/c07cf9ca-4da8-4bde-96d0-4c428d5da979-kube-api-access-9h9p8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.797151 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.797123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:37.888251 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.888222    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"]
Jul 21 01:42:37.890771 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.890747    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:37.900533 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.900507    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"]
Jul 21 01:42:37.905592 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.905570    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:37.905682 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.905610    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lm9b\" (UniqueName: \"kubernetes.io/projected/7fbc8207-f639-472c-85a5-d347f19eb66d-kube-api-access-5lm9b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:37.905682 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.905632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:37.925342 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:37.925299    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"]
Jul 21 01:42:37.927783 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:42:37.927752    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07cf9ca_4da8_4bde_96d0_4c428d5da979.slice/crio-b5d0bed5862b06d92e2d7534bc1f0bdc4651737b87d02c49d3c5a184afa0cbc3 WatchSource:0}: Error finding container b5d0bed5862b06d92e2d7534bc1f0bdc4651737b87d02c49d3c5a184afa0cbc3: Status 404 returned error can't find the container with id b5d0bed5862b06d92e2d7534bc1f0bdc4651737b87d02c49d3c5a184afa0cbc3
Jul 21 01:42:38.006320 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.006278    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:38.006448 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.006428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:38.006528 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.006510    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lm9b\" (UniqueName: \"kubernetes.io/projected/7fbc8207-f639-472c-85a5-d347f19eb66d-kube-api-access-5lm9b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:38.006605 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.006588    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:38.006756 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.006737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:38.014094 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.014070    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lm9b\" (UniqueName: \"kubernetes.io/projected/7fbc8207-f639-472c-85a5-d347f19eb66d-kube-api-access-5lm9b\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:38.073122 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.073070    2568 generic.go:356] "Generic (PLEG): container finished" podID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerID="adffa073ff3aa6f1fc8971e26ca47b31a566691403d9cb180cfe11fee06df479" exitCode=0
Jul 21 01:42:38.073210 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.073169    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw" event={"ID":"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3","Type":"ContainerDied","Data":"adffa073ff3aa6f1fc8971e26ca47b31a566691403d9cb180cfe11fee06df479"}
Jul 21 01:42:38.073264 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.073221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw" event={"ID":"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3","Type":"ContainerStarted","Data":"f7d28b9eee6d9b29448e80e90abeb73d4a939fbfece40b500ac50d77cf23b7fd"}
Jul 21 01:42:38.074712 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.074692    2568 generic.go:356] "Generic (PLEG): container finished" podID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerID="873b9e486a260e0110ecfa01c68dd7b3f7cc949347f7468bc4ab2fa39ea78b03" exitCode=0
Jul 21 01:42:38.074775 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.074760    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9" event={"ID":"c07cf9ca-4da8-4bde-96d0-4c428d5da979","Type":"ContainerDied","Data":"873b9e486a260e0110ecfa01c68dd7b3f7cc949347f7468bc4ab2fa39ea78b03"}
Jul 21 01:42:38.074829 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.074788    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9" event={"ID":"c07cf9ca-4da8-4bde-96d0-4c428d5da979","Type":"ContainerStarted","Data":"b5d0bed5862b06d92e2d7534bc1f0bdc4651737b87d02c49d3c5a184afa0cbc3"}
Jul 21 01:42:38.076380 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.076240    2568 generic.go:356] "Generic (PLEG): container finished" podID="7445dcf0-a628-4066-adae-6523eb0200c9" containerID="74ae5aceded1b7a352b7b41725ee885261b6c345d22d29704e96c72be977a04d" exitCode=0
Jul 21 01:42:38.076380 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.076330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd" event={"ID":"7445dcf0-a628-4066-adae-6523eb0200c9","Type":"ContainerDied","Data":"74ae5aceded1b7a352b7b41725ee885261b6c345d22d29704e96c72be977a04d"}
Jul 21 01:42:38.076380 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.076377    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd" event={"ID":"7445dcf0-a628-4066-adae-6523eb0200c9","Type":"ContainerStarted","Data":"91ddd55c8499d5b56471d3b5ff293132bb74bc691ccf06c3a476254200ec43c1"}
Jul 21 01:42:38.202216 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.202190    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:38.322825 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:38.322800    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"]
Jul 21 01:42:38.325016 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:42:38.324957    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbc8207_f639_472c_85a5_d347f19eb66d.slice/crio-4d43cdbab60215eae5e9de2a1931c00cef77d29edcd93ced63da96957fa37a3a WatchSource:0}: Error finding container 4d43cdbab60215eae5e9de2a1931c00cef77d29edcd93ced63da96957fa37a3a: Status 404 returned error can't find the container with id 4d43cdbab60215eae5e9de2a1931c00cef77d29edcd93ced63da96957fa37a3a
Jul 21 01:42:39.081915 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.081879    2568 generic.go:356] "Generic (PLEG): container finished" podID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerID="d76333a48953f9fc5000f08f91ec987eab712aced32efa020bb9cf3b1938e123" exitCode=0
Jul 21 01:42:39.082295 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.081965    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw" event={"ID":"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3","Type":"ContainerDied","Data":"d76333a48953f9fc5000f08f91ec987eab712aced32efa020bb9cf3b1938e123"}
Jul 21 01:42:39.083853 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.083835    2568 generic.go:356] "Generic (PLEG): container finished" podID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerID="0b84809d593c80310d772538c62fcd2db239d543c6059c43835f0baecb115888" exitCode=0
Jul 21 01:42:39.083942 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.083898    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9" event={"ID":"c07cf9ca-4da8-4bde-96d0-4c428d5da979","Type":"ContainerDied","Data":"0b84809d593c80310d772538c62fcd2db239d543c6059c43835f0baecb115888"}
Jul 21 01:42:39.085664 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.085641    2568 generic.go:356] "Generic (PLEG): container finished" podID="7445dcf0-a628-4066-adae-6523eb0200c9" containerID="8b3da0e7e4ebb6a51af01801be0b781da2ce29af80803af7342c8316ab04997b" exitCode=0
Jul 21 01:42:39.085774 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.085745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd" event={"ID":"7445dcf0-a628-4066-adae-6523eb0200c9","Type":"ContainerDied","Data":"8b3da0e7e4ebb6a51af01801be0b781da2ce29af80803af7342c8316ab04997b"}
Jul 21 01:42:39.087402 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.087379    2568 generic.go:356] "Generic (PLEG): container finished" podID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerID="fc8da768ad80a2412bc12eb191a1ccd3c5c3d7619ce456b5d97c08ce87bf7846" exitCode=0
Jul 21 01:42:39.087499 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.087411    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g" event={"ID":"7fbc8207-f639-472c-85a5-d347f19eb66d","Type":"ContainerDied","Data":"fc8da768ad80a2412bc12eb191a1ccd3c5c3d7619ce456b5d97c08ce87bf7846"}
Jul 21 01:42:39.087499 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:39.087453    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g" event={"ID":"7fbc8207-f639-472c-85a5-d347f19eb66d","Type":"ContainerStarted","Data":"4d43cdbab60215eae5e9de2a1931c00cef77d29edcd93ced63da96957fa37a3a"}
Jul 21 01:42:40.093088 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:40.093010    2568 generic.go:356] "Generic (PLEG): container finished" podID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerID="73f12f8000373cb88e5e296f92172fd564b96b899b0c34df81ad4026d1e9742d" exitCode=0
Jul 21 01:42:40.093463 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:40.093105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g" event={"ID":"7fbc8207-f639-472c-85a5-d347f19eb66d","Type":"ContainerDied","Data":"73f12f8000373cb88e5e296f92172fd564b96b899b0c34df81ad4026d1e9742d"}
Jul 21 01:42:40.095418 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:40.095395    2568 generic.go:356] "Generic (PLEG): container finished" podID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerID="b8d0f95ab182588fc19014a9e3e982ba5da6757ab9dd689a755d559624b80184" exitCode=0
Jul 21 01:42:40.095506 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:40.095477    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw" event={"ID":"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3","Type":"ContainerDied","Data":"b8d0f95ab182588fc19014a9e3e982ba5da6757ab9dd689a755d559624b80184"}
Jul 21 01:42:40.097574 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:40.097554    2568 generic.go:356] "Generic (PLEG): container finished" podID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerID="1a000ed91ca2021da3052129b655aa87b3c36df4081a6ddcf8a70ee740d407bb" exitCode=0
Jul 21 01:42:40.097658 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:40.097630    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9" event={"ID":"c07cf9ca-4da8-4bde-96d0-4c428d5da979","Type":"ContainerDied","Data":"1a000ed91ca2021da3052129b655aa87b3c36df4081a6ddcf8a70ee740d407bb"}
Jul 21 01:42:40.099634 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:40.099616    2568 generic.go:356] "Generic (PLEG): container finished" podID="7445dcf0-a628-4066-adae-6523eb0200c9" containerID="86d995788977084c61bf701e512512af27d6c2a1da69c6576b183d308a437eaa" exitCode=0
Jul 21 01:42:40.099711 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:40.099643    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd" event={"ID":"7445dcf0-a628-4066-adae-6523eb0200c9","Type":"ContainerDied","Data":"86d995788977084c61bf701e512512af27d6c2a1da69c6576b183d308a437eaa"}
Jul 21 01:42:41.107488 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.107456    2568 generic.go:356] "Generic (PLEG): container finished" podID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerID="cfaa5fd6ba231b36ebb7f0f6bf0bcc9c31a672f213e5fcc04d7f9b59c2bcd1ad" exitCode=0
Jul 21 01:42:41.107957 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.107538    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g" event={"ID":"7fbc8207-f639-472c-85a5-d347f19eb66d","Type":"ContainerDied","Data":"cfaa5fd6ba231b36ebb7f0f6bf0bcc9c31a672f213e5fcc04d7f9b59c2bcd1ad"}
Jul 21 01:42:41.248065 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.248041    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:41.289413 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.289393    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:41.292380 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.292360    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:41.332795 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.332762    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h9p8\" (UniqueName: \"kubernetes.io/projected/c07cf9ca-4da8-4bde-96d0-4c428d5da979-kube-api-access-9h9p8\") pod \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") "
Jul 21 01:42:41.332795 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.332801    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh8m4\" (UniqueName: \"kubernetes.io/projected/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-kube-api-access-vh8m4\") pod \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") "
Jul 21 01:42:41.333025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.332843    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-util\") pod \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") "
Jul 21 01:42:41.333025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.332914    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-bundle\") pod \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") "
Jul 21 01:42:41.333025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.332962    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-bundle\") pod \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\" (UID: \"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3\") "
Jul 21 01:42:41.333025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.332987    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfgfs\" (UniqueName: \"kubernetes.io/projected/7445dcf0-a628-4066-adae-6523eb0200c9-kube-api-access-cfgfs\") pod \"7445dcf0-a628-4066-adae-6523eb0200c9\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") "
Jul 21 01:42:41.333025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.333013    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-bundle\") pod \"7445dcf0-a628-4066-adae-6523eb0200c9\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") "
Jul 21 01:42:41.333271 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.333057    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-util\") pod \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\" (UID: \"c07cf9ca-4da8-4bde-96d0-4c428d5da979\") "
Jul 21 01:42:41.333271 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.333086    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-util\") pod \"7445dcf0-a628-4066-adae-6523eb0200c9\" (UID: \"7445dcf0-a628-4066-adae-6523eb0200c9\") "
Jul 21 01:42:41.334148 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.333965    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-bundle" (OuterVolumeSpecName: "bundle") pod "7445dcf0-a628-4066-adae-6523eb0200c9" (UID: "7445dcf0-a628-4066-adae-6523eb0200c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:42:41.334425 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.334232    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-bundle" (OuterVolumeSpecName: "bundle") pod "c07cf9ca-4da8-4bde-96d0-4c428d5da979" (UID: "c07cf9ca-4da8-4bde-96d0-4c428d5da979"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:42:41.335214 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.334740    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-bundle" (OuterVolumeSpecName: "bundle") pod "c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" (UID: "c87ca6cd-2c35-4086-ba41-bce02fa0e2a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:42:41.335812 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.335778    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c07cf9ca-4da8-4bde-96d0-4c428d5da979-kube-api-access-9h9p8" (OuterVolumeSpecName: "kube-api-access-9h9p8") pod "c07cf9ca-4da8-4bde-96d0-4c428d5da979" (UID: "c07cf9ca-4da8-4bde-96d0-4c428d5da979"). InnerVolumeSpecName "kube-api-access-9h9p8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:42:41.335812 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.335795    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-kube-api-access-vh8m4" (OuterVolumeSpecName: "kube-api-access-vh8m4") pod "c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" (UID: "c87ca6cd-2c35-4086-ba41-bce02fa0e2a3"). InnerVolumeSpecName "kube-api-access-vh8m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:42:41.337268 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.337243    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7445dcf0-a628-4066-adae-6523eb0200c9-kube-api-access-cfgfs" (OuterVolumeSpecName: "kube-api-access-cfgfs") pod "7445dcf0-a628-4066-adae-6523eb0200c9" (UID: "7445dcf0-a628-4066-adae-6523eb0200c9"). InnerVolumeSpecName "kube-api-access-cfgfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:42:41.338780 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.338751    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-util" (OuterVolumeSpecName: "util") pod "c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" (UID: "c87ca6cd-2c35-4086-ba41-bce02fa0e2a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:42:41.340480 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.340458    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-util" (OuterVolumeSpecName: "util") pod "7445dcf0-a628-4066-adae-6523eb0200c9" (UID: "7445dcf0-a628-4066-adae-6523eb0200c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:42:41.341284 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.341265    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-util" (OuterVolumeSpecName: "util") pod "c07cf9ca-4da8-4bde-96d0-4c428d5da979" (UID: "c07cf9ca-4da8-4bde-96d0-4c428d5da979"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:42:41.434426 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434397    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-util\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:41.434426 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434420    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:41.434426 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434429    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:41.434625 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434437    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfgfs\" (UniqueName: \"kubernetes.io/projected/7445dcf0-a628-4066-adae-6523eb0200c9-kube-api-access-cfgfs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:41.434625 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434447    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:41.434625 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434454    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c07cf9ca-4da8-4bde-96d0-4c428d5da979-util\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:41.434625 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434461    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7445dcf0-a628-4066-adae-6523eb0200c9-util\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:41.434625 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434468    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h9p8\" (UniqueName: \"kubernetes.io/projected/c07cf9ca-4da8-4bde-96d0-4c428d5da979-kube-api-access-9h9p8\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:41.434625 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:41.434476    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh8m4\" (UniqueName: \"kubernetes.io/projected/c87ca6cd-2c35-4086-ba41-bce02fa0e2a3-kube-api-access-vh8m4\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:42.113817 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.113794    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw"
Jul 21 01:42:42.114292 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.113797    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw" event={"ID":"c87ca6cd-2c35-4086-ba41-bce02fa0e2a3","Type":"ContainerDied","Data":"f7d28b9eee6d9b29448e80e90abeb73d4a939fbfece40b500ac50d77cf23b7fd"}
Jul 21 01:42:42.114292 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.113917    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7d28b9eee6d9b29448e80e90abeb73d4a939fbfece40b500ac50d77cf23b7fd"
Jul 21 01:42:42.115639 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.115614    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9" event={"ID":"c07cf9ca-4da8-4bde-96d0-4c428d5da979","Type":"ContainerDied","Data":"b5d0bed5862b06d92e2d7534bc1f0bdc4651737b87d02c49d3c5a184afa0cbc3"}
Jul 21 01:42:42.115742 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.115636    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9"
Jul 21 01:42:42.115742 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.115656    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5d0bed5862b06d92e2d7534bc1f0bdc4651737b87d02c49d3c5a184afa0cbc3"
Jul 21 01:42:42.117776 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.117746    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd" event={"ID":"7445dcf0-a628-4066-adae-6523eb0200c9","Type":"ContainerDied","Data":"91ddd55c8499d5b56471d3b5ff293132bb74bc691ccf06c3a476254200ec43c1"}
Jul 21 01:42:42.117867 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.117789    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91ddd55c8499d5b56471d3b5ff293132bb74bc691ccf06c3a476254200ec43c1"
Jul 21 01:42:42.117867 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.117755    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd"
Jul 21 01:42:42.230570 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.230548    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:42.340495 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.340450    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-util\") pod \"7fbc8207-f639-472c-85a5-d347f19eb66d\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") "
Jul 21 01:42:42.340684 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.340547    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lm9b\" (UniqueName: \"kubernetes.io/projected/7fbc8207-f639-472c-85a5-d347f19eb66d-kube-api-access-5lm9b\") pod \"7fbc8207-f639-472c-85a5-d347f19eb66d\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") "
Jul 21 01:42:42.340684 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.340602    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-bundle\") pod \"7fbc8207-f639-472c-85a5-d347f19eb66d\" (UID: \"7fbc8207-f639-472c-85a5-d347f19eb66d\") "
Jul 21 01:42:42.341163 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.341132    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-bundle" (OuterVolumeSpecName: "bundle") pod "7fbc8207-f639-472c-85a5-d347f19eb66d" (UID: "7fbc8207-f639-472c-85a5-d347f19eb66d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:42:42.342580 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.342536    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fbc8207-f639-472c-85a5-d347f19eb66d-kube-api-access-5lm9b" (OuterVolumeSpecName: "kube-api-access-5lm9b") pod "7fbc8207-f639-472c-85a5-d347f19eb66d" (UID: "7fbc8207-f639-472c-85a5-d347f19eb66d"). InnerVolumeSpecName "kube-api-access-5lm9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:42:42.346684 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.346660    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-util" (OuterVolumeSpecName: "util") pod "7fbc8207-f639-472c-85a5-d347f19eb66d" (UID: "7fbc8207-f639-472c-85a5-d347f19eb66d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:42:42.441907 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.441829    2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:42.441907 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.441856    2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fbc8207-f639-472c-85a5-d347f19eb66d-util\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:42.441907 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:42.441866    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lm9b\" (UniqueName: \"kubernetes.io/projected/7fbc8207-f639-472c-85a5-d347f19eb66d-kube-api-access-5lm9b\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:42:43.123897 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:43.123854    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g" event={"ID":"7fbc8207-f639-472c-85a5-d347f19eb66d","Type":"ContainerDied","Data":"4d43cdbab60215eae5e9de2a1931c00cef77d29edcd93ced63da96957fa37a3a"}
Jul 21 01:42:43.123897 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:43.123896    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g"
Jul 21 01:42:43.124340 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:42:43.123914    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d43cdbab60215eae5e9de2a1931c00cef77d29edcd93ced63da96957fa37a3a"
Jul 21 01:44:42.456088 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456056    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"]
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456340    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerName="pull"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456352    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerName="pull"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456361    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerName="pull"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456366    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerName="pull"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456373    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerName="util"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456378    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerName="util"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456388    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7445dcf0-a628-4066-adae-6523eb0200c9" containerName="pull"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456393    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7445dcf0-a628-4066-adae-6523eb0200c9" containerName="pull"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456401    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7445dcf0-a628-4066-adae-6523eb0200c9" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456406    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7445dcf0-a628-4066-adae-6523eb0200c9" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456412    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456417    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456424    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerName="util"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456429    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerName="util"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456435    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456440    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456451    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7445dcf0-a628-4066-adae-6523eb0200c9" containerName="util"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456455    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7445dcf0-a628-4066-adae-6523eb0200c9" containerName="util"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456462    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerName="util"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456467    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerName="util"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456472    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456477    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456482    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerName="pull"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456487    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerName="pull"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456542    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7445dcf0-a628-4066-adae-6523eb0200c9" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456549    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fbc8207-f639-472c-85a5-d347f19eb66d" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456555    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c07cf9ca-4da8-4bde-96d0-4c428d5da979" containerName="extract"
Jul 21 01:44:42.456547 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.456560    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c87ca6cd-2c35-4086-ba41-bce02fa0e2a3" containerName="extract"
Jul 21 01:44:42.458366 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.458349    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:42.460818 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.460797    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 01:44:42.461643 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.461624    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 01:44:42.461754 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.461631    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 01:44:42.461754 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.461691    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-gq4jg\""
Jul 21 01:44:42.466858 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.466836    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"]
Jul 21 01:44:42.599243 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.599209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2454bf10-fb56-40db-9809-ce5d22db92bb-data\") pod \"postgres-69fb4594cf-bnhns\" (UID: \"2454bf10-fb56-40db-9809-ce5d22db92bb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:42.599416 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.599255    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzq7d\" (UniqueName: \"kubernetes.io/projected/2454bf10-fb56-40db-9809-ce5d22db92bb-kube-api-access-dzq7d\") pod \"postgres-69fb4594cf-bnhns\" (UID: \"2454bf10-fb56-40db-9809-ce5d22db92bb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:42.699664 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.699631    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzq7d\" (UniqueName: \"kubernetes.io/projected/2454bf10-fb56-40db-9809-ce5d22db92bb-kube-api-access-dzq7d\") pod \"postgres-69fb4594cf-bnhns\" (UID: \"2454bf10-fb56-40db-9809-ce5d22db92bb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:42.699824 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.699724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2454bf10-fb56-40db-9809-ce5d22db92bb-data\") pod \"postgres-69fb4594cf-bnhns\" (UID: \"2454bf10-fb56-40db-9809-ce5d22db92bb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:42.700023 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.700009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2454bf10-fb56-40db-9809-ce5d22db92bb-data\") pod \"postgres-69fb4594cf-bnhns\" (UID: \"2454bf10-fb56-40db-9809-ce5d22db92bb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:42.707905 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.707843    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzq7d\" (UniqueName: \"kubernetes.io/projected/2454bf10-fb56-40db-9809-ce5d22db92bb-kube-api-access-dzq7d\") pod \"postgres-69fb4594cf-bnhns\" (UID: \"2454bf10-fb56-40db-9809-ce5d22db92bb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:42.768924 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.768888    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:42.894318 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:42.894284    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"]
Jul 21 01:44:42.896173 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:44:42.896140    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2454bf10_fb56_40db_9809_ce5d22db92bb.slice/crio-1af97ba6099565f283bd215d79f2348a66e19ba813603ebca7d564b5d154c8f3 WatchSource:0}: Error finding container 1af97ba6099565f283bd215d79f2348a66e19ba813603ebca7d564b5d154c8f3: Status 404 returned error can't find the container with id 1af97ba6099565f283bd215d79f2348a66e19ba813603ebca7d564b5d154c8f3
Jul 21 01:44:43.638865 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:43.638827    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns" event={"ID":"2454bf10-fb56-40db-9809-ce5d22db92bb","Type":"ContainerStarted","Data":"1af97ba6099565f283bd215d79f2348a66e19ba813603ebca7d564b5d154c8f3"}
Jul 21 01:44:48.665354 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:48.665300    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns" event={"ID":"2454bf10-fb56-40db-9809-ce5d22db92bb","Type":"ContainerStarted","Data":"d848e3003f4b2fd5470fc0b8aa3231530677b58a12c66733b57d6acfaab71fd1"}
Jul 21 01:44:48.665749 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:48.665482    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:44:48.679968 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:48.679924    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns" podStartSLOduration=1.933013836 podStartE2EDuration="6.679911189s" totalImagesPullingTime="4.746897353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:44:48.678599302 +0000 UTC m=+505.523592916" watchObservedRunningTime="2026-07-21 01:44:48.679911189 +0000 UTC m=+505.524904783"
Jul 21 01:44:54.698816 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:44:54.698784    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnhns"
Jul 21 01:45:37.905756 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:37.905723    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-665dc6758-7g52b"]
Jul 21 01:45:37.909175 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:37.909158    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:37.911482 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:37.911457    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 01:45:37.911588 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:37.911502    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-z67q6\""
Jul 21 01:45:37.917834 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:37.917815    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-665dc6758-7g52b"]
Jul 21 01:45:38.011333 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.011279    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q46zz\" (UniqueName: \"kubernetes.io/projected/883e2761-c098-4f6f-a532-c7992b4915da-kube-api-access-q46zz\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.011470 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.011366    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/883e2761-c098-4f6f-a532-c7992b4915da-maas-api-tls\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.011470 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.011391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/883e2761-c098-4f6f-a532-c7992b4915da-openshift-service-ca\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.112676 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.112645    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q46zz\" (UniqueName: \"kubernetes.io/projected/883e2761-c098-4f6f-a532-c7992b4915da-kube-api-access-q46zz\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.112823 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.112687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/883e2761-c098-4f6f-a532-c7992b4915da-maas-api-tls\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.112823 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.112702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/883e2761-c098-4f6f-a532-c7992b4915da-openshift-service-ca\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.113277 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.113259    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/883e2761-c098-4f6f-a532-c7992b4915da-openshift-service-ca\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.115093 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.115071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/883e2761-c098-4f6f-a532-c7992b4915da-maas-api-tls\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.120358 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.120333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q46zz\" (UniqueName: \"kubernetes.io/projected/883e2761-c098-4f6f-a532-c7992b4915da-kube-api-access-q46zz\") pod \"maas-api-665dc6758-7g52b\" (UID: \"883e2761-c098-4f6f-a532-c7992b4915da\") " pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.219603 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.219542    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:38.351423 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.351401    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-665dc6758-7g52b"]
Jul 21 01:45:38.353887 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:45:38.353856    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883e2761_c098_4f6f_a532_c7992b4915da.slice/crio-ce8d0cba9689274ed82684d6b6c7746492ee1f6bc08bc371b030010fd83c5def WatchSource:0}: Error finding container ce8d0cba9689274ed82684d6b6c7746492ee1f6bc08bc371b030010fd83c5def: Status 404 returned error can't find the container with id ce8d0cba9689274ed82684d6b6c7746492ee1f6bc08bc371b030010fd83c5def
Jul 21 01:45:38.877240 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:38.877204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b" event={"ID":"883e2761-c098-4f6f-a532-c7992b4915da","Type":"ContainerStarted","Data":"ce8d0cba9689274ed82684d6b6c7746492ee1f6bc08bc371b030010fd83c5def"}
Jul 21 01:45:40.888705 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:40.888665    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b" event={"ID":"883e2761-c098-4f6f-a532-c7992b4915da","Type":"ContainerStarted","Data":"ea6a66e139822195d87d7ee145db58813ec159f54e07558bd851ba2a9f7e03d8"}
Jul 21 01:45:40.889079 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:40.888739    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:45:40.906191 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:40.906111    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b" podStartSLOduration=1.604144716 podStartE2EDuration="3.906095783s" totalImagesPullingTime="2.301951067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:45:40.904158851 +0000 UTC m=+557.749152470" watchObservedRunningTime="2026-07-21 01:45:40.906095783 +0000 UTC m=+557.751089377"
Jul 21 01:45:46.898235 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:45:46.898204    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-665dc6758-7g52b"
Jul 21 01:46:30.095075 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.095036    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"]
Jul 21 01:46:30.098445 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.098427    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.101900 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.101870    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fqk5w\""
Jul 21 01:46:30.102004 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.101878    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 01:46:30.102004 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.101889    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 01:46:30.102118 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.102087    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 01:46:30.109318 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.109284    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"]
Jul 21 01:46:30.188992 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.188962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.189124 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.189012    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.189124 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.189041    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7tvt\" (UniqueName: \"kubernetes.io/projected/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-kube-api-access-z7tvt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.189124 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.189060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.189124 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.189080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.189124 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.189095    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.289993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7tvt\" (UniqueName: \"kubernetes.io/projected/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-kube-api-access-z7tvt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290020 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.290022    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290220 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.290043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290220 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.290061    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290220 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.290101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290220 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.290137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290548 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.290524    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290604 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.290549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.290639 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.290608    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.292352 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.292335    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.292497 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.292467    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.299917 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.299897    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7tvt\" (UniqueName: \"kubernetes.io/projected/68b81b2e-7c7d-4abd-b446-3c88e05bc84a-kube-api-access-z7tvt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7cw28\" (UID: \"68b81b2e-7c7d-4abd-b446-3c88e05bc84a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.409968 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.409944    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:30.536512 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.536489    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"]
Jul 21 01:46:30.538052 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:46:30.538025    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b81b2e_7c7d_4abd_b446_3c88e05bc84a.slice/crio-92a0ca3a7a25830258d442291834b3ed64e0f4c8d816f67788c59bf9d65ea4eb WatchSource:0}: Error finding container 92a0ca3a7a25830258d442291834b3ed64e0f4c8d816f67788c59bf9d65ea4eb: Status 404 returned error can't find the container with id 92a0ca3a7a25830258d442291834b3ed64e0f4c8d816f67788c59bf9d65ea4eb
Jul 21 01:46:30.539441 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:30.539424    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 01:46:31.112627 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:31.112587    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28" event={"ID":"68b81b2e-7c7d-4abd-b446-3c88e05bc84a","Type":"ContainerStarted","Data":"92a0ca3a7a25830258d442291834b3ed64e0f4c8d816f67788c59bf9d65ea4eb"}
Jul 21 01:46:32.119181 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:32.119148    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28" event={"ID":"68b81b2e-7c7d-4abd-b446-3c88e05bc84a","Type":"ContainerStarted","Data":"3ed5211dc49fa2ee0837f521b2bcb2421e4334e02bb9c4289a47e552bfdcfb2c"}
Jul 21 01:46:32.136963 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:32.136910    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28" podStartSLOduration=1.152691642 podStartE2EDuration="2.13689565s" totalImagesPullingTime="984.204008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:46:32.135367531 +0000 UTC m=+608.980361126" watchObservedRunningTime="2026-07-21 01:46:32.13689565 +0000 UTC m=+608.981889245"
Jul 21 01:46:40.410561 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.410527    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:40.410946 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.410582    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:40.422855 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.422830    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:40.773336 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.773244    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"]
Jul 21 01:46:40.776551 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.776534    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.779081 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.779061    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 21 01:46:40.788055 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.788033    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"]
Jul 21 01:46:40.866395 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.866366    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.866569 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.866403    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.866569 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.866434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.866569 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.866490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cb375eb-1bbf-44c3-ba87-25638ee949cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.866569 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.866509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pddd\" (UniqueName: \"kubernetes.io/projected/5cb375eb-1bbf-44c3-ba87-25638ee949cf-kube-api-access-4pddd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.866746 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.866579    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.967969 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.967931    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.968155 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.967990    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cb375eb-1bbf-44c3-ba87-25638ee949cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.968155 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.968018    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pddd\" (UniqueName: \"kubernetes.io/projected/5cb375eb-1bbf-44c3-ba87-25638ee949cf-kube-api-access-4pddd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.968155 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.968051    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.968155 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.968105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.968155 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.968131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.968608 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.968573    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.968608 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.968589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.968800 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.968720    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.970519 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.970497    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cb375eb-1bbf-44c3-ba87-25638ee949cf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.970787 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.970766    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cb375eb-1bbf-44c3-ba87-25638ee949cf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:40.976850 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:40.976826    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pddd\" (UniqueName: \"kubernetes.io/projected/5cb375eb-1bbf-44c3-ba87-25638ee949cf-kube-api-access-4pddd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rc2gh\" (UID: \"5cb375eb-1bbf-44c3-ba87-25638ee949cf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:41.085999 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:41.085913    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:41.171012 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:41.170892    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7cw28"
Jul 21 01:46:41.220665 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:41.220640    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"]
Jul 21 01:46:41.222031 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:46:41.222011    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb375eb_1bbf_44c3_ba87_25638ee949cf.slice/crio-2287d329d63fb878b1057f9f591da87b1909cc118b986f1ba410a7575f905256 WatchSource:0}: Error finding container 2287d329d63fb878b1057f9f591da87b1909cc118b986f1ba410a7575f905256: Status 404 returned error can't find the container with id 2287d329d63fb878b1057f9f591da87b1909cc118b986f1ba410a7575f905256
Jul 21 01:46:42.163631 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:42.163598    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh" event={"ID":"5cb375eb-1bbf-44c3-ba87-25638ee949cf","Type":"ContainerStarted","Data":"e7b8b97981c57b3875d4b7d0adee57ccd4057c19fa1f3131c654e3971110882c"}
Jul 21 01:46:42.164025 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:42.163653    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh" event={"ID":"5cb375eb-1bbf-44c3-ba87-25638ee949cf","Type":"ContainerStarted","Data":"2287d329d63fb878b1057f9f591da87b1909cc118b986f1ba410a7575f905256"}
Jul 21 01:46:42.182873 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:42.182826    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh" podStartSLOduration=2.013387448 podStartE2EDuration="2.182811295s" totalImagesPullingTime="169.423847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:46:42.181294146 +0000 UTC m=+619.026287741" watchObservedRunningTime="2026-07-21 01:46:42.182811295 +0000 UTC m=+619.027804890"
Jul 21 01:46:51.087011 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:51.086932    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:51.087011 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:51.087005    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:51.099288 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:51.099268    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:46:51.215774 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:46:51.215742    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rc2gh"
Jul 21 01:58:48.078462 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.078376    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"]
Jul 21 01:58:48.081460 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.081442    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.084004 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.083984    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c8ffc4b3-kserve-self-signed-certs\""
Jul 21 01:58:48.092833 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.092813    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"]
Jul 21 01:58:48.180093 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.180065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-model-cache\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.180093 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.180096    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tls-certs\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.180272 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.180116    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjmfx\" (UniqueName: \"kubernetes.io/projected/88f7bbe3-2504-451d-9a3c-c3f77faae16f-kube-api-access-bjmfx\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.180272 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.180205    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-dshm\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.180272 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.180247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-home\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.180455 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.180376    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tmp-dir\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281378 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281353    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tmp-dir\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281378 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-model-cache\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281593 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281400    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tls-certs\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281593 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjmfx\" (UniqueName: \"kubernetes.io/projected/88f7bbe3-2504-451d-9a3c-c3f77faae16f-kube-api-access-bjmfx\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281593 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281469    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-dshm\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281593 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281500    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-home\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281819 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281790    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tmp-dir\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281892 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281831    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-model-cache\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.281892 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.281881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-home\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.283757 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.283737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-dshm\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.283919 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.283902    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tls-certs\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.290292 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.290273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjmfx\" (UniqueName: \"kubernetes.io/projected/88f7bbe3-2504-451d-9a3c-c3f77faae16f-kube-api-access-bjmfx\") pod \"e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") " pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.391131 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.391092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:48.521125 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:48.521098    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"]
Jul 21 01:58:48.523013 ip-10-0-138-80 kubenswrapper[2568]: W0721 01:58:48.522989    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88f7bbe3_2504_451d_9a3c_c3f77faae16f.slice/crio-ddffc468231f29391a2c79a8c443946eb2a14c5f0945ca7e8b4f09d02e00e684 WatchSource:0}: Error finding container ddffc468231f29391a2c79a8c443946eb2a14c5f0945ca7e8b4f09d02e00e684: Status 404 returned error can't find the container with id ddffc468231f29391a2c79a8c443946eb2a14c5f0945ca7e8b4f09d02e00e684
Jul 21 01:58:49.424027 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:49.423995    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns" event={"ID":"88f7bbe3-2504-451d-9a3c-c3f77faae16f","Type":"ContainerStarted","Data":"61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7"}
Jul 21 01:58:49.424027 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:49.424032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns" event={"ID":"88f7bbe3-2504-451d-9a3c-c3f77faae16f","Type":"ContainerStarted","Data":"ddffc468231f29391a2c79a8c443946eb2a14c5f0945ca7e8b4f09d02e00e684"}
Jul 21 01:58:49.450505 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:49.450461    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns" podStartSLOduration=1.450446141 podStartE2EDuration="1.450446141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:58:49.448627538 +0000 UTC m=+1346.293621135" watchObservedRunningTime="2026-07-21 01:58:49.450446141 +0000 UTC m=+1346.295439735"
Jul 21 01:58:58.391820 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:58.391783    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:58.392289 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:58.391842    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:58.403985 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:58.403961    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:58:58.476619 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:58:58.476591    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:59:15.925588 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:15.925553    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"]
Jul 21 01:59:30.944946 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:30.944880    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns" podUID="88f7bbe3-2504-451d-9a3c-c3f77faae16f" containerName="main" containerID="cri-o://61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7" gracePeriod=45
Jul 21 01:59:31.182497 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.182469    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:59:31.318381 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318281    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tls-certs\") pod \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") "
Jul 21 01:59:31.318381 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318331    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-home\") pod \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") "
Jul 21 01:59:31.318381 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318384    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-model-cache\") pod \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") "
Jul 21 01:59:31.318664 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318515    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tmp-dir\") pod \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") "
Jul 21 01:59:31.318664 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318585    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjmfx\" (UniqueName: \"kubernetes.io/projected/88f7bbe3-2504-451d-9a3c-c3f77faae16f-kube-api-access-bjmfx\") pod \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") "
Jul 21 01:59:31.318664 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318600    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-model-cache" (OuterVolumeSpecName: "model-cache") pod "88f7bbe3-2504-451d-9a3c-c3f77faae16f" (UID: "88f7bbe3-2504-451d-9a3c-c3f77faae16f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:59:31.318664 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318631    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-dshm\") pod \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\" (UID: \"88f7bbe3-2504-451d-9a3c-c3f77faae16f\") "
Jul 21 01:59:31.318872 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318671    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-home" (OuterVolumeSpecName: "home") pod "88f7bbe3-2504-451d-9a3c-c3f77faae16f" (UID: "88f7bbe3-2504-451d-9a3c-c3f77faae16f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:59:31.318872 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318725    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88f7bbe3-2504-451d-9a3c-c3f77faae16f" (UID: "88f7bbe3-2504-451d-9a3c-c3f77faae16f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:59:31.318945 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318892    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-model-cache\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:59:31.318945 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318909    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tmp-dir\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:59:31.318945 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.318920    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-home\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:59:31.320606 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.320581    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88f7bbe3-2504-451d-9a3c-c3f77faae16f" (UID: "88f7bbe3-2504-451d-9a3c-c3f77faae16f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:59:31.320704 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.320636    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-dshm" (OuterVolumeSpecName: "dshm") pod "88f7bbe3-2504-451d-9a3c-c3f77faae16f" (UID: "88f7bbe3-2504-451d-9a3c-c3f77faae16f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 01:59:31.320748 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.320724    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f7bbe3-2504-451d-9a3c-c3f77faae16f-kube-api-access-bjmfx" (OuterVolumeSpecName: "kube-api-access-bjmfx") pod "88f7bbe3-2504-451d-9a3c-c3f77faae16f" (UID: "88f7bbe3-2504-451d-9a3c-c3f77faae16f"). InnerVolumeSpecName "kube-api-access-bjmfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:59:31.419583 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.419547    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjmfx\" (UniqueName: \"kubernetes.io/projected/88f7bbe3-2504-451d-9a3c-c3f77faae16f-kube-api-access-bjmfx\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:59:31.419583 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.419576    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f7bbe3-2504-451d-9a3c-c3f77faae16f-dshm\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:59:31.419583 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.419587    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f7bbe3-2504-451d-9a3c-c3f77faae16f-tls-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 01:59:31.628304 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.628269    2568 generic.go:356] "Generic (PLEG): container finished" podID="88f7bbe3-2504-451d-9a3c-c3f77faae16f" containerID="61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7" exitCode=0
Jul 21 01:59:31.628486 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.628325    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"
Jul 21 01:59:31.628486 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.628348    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns" event={"ID":"88f7bbe3-2504-451d-9a3c-c3f77faae16f","Type":"ContainerDied","Data":"61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7"}
Jul 21 01:59:31.628486 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.628395    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns" event={"ID":"88f7bbe3-2504-451d-9a3c-c3f77faae16f","Type":"ContainerDied","Data":"ddffc468231f29391a2c79a8c443946eb2a14c5f0945ca7e8b4f09d02e00e684"}
Jul 21 01:59:31.628486 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.628430    2568 scope.go:117] "RemoveContainer" containerID="61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7"
Jul 21 01:59:31.639057 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.639039    2568 scope.go:117] "RemoveContainer" containerID="61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7"
Jul 21 01:59:31.639335 ip-10-0-138-80 kubenswrapper[2568]: E0721 01:59:31.639300    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7\": container with ID starting with 61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7 not found: ID does not exist" containerID="61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7"
Jul 21 01:59:31.639402 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.639342    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7"} err="failed to get container status \"61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7\": rpc error: code = NotFound desc = could not find container \"61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7\": container with ID starting with 61ea1a853e3f92933bc0e4a27c84e70eb2ba0b368019ec4ab46b2a94c1cfebf7 not found: ID does not exist"
Jul 21 01:59:31.651558 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.651533    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"]
Jul 21 01:59:31.655549 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.655516    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c8ffc4b3-kserve-9b6bffdcf-wg9ns"]
Jul 21 01:59:31.726022 ip-10-0-138-80 kubenswrapper[2568]: I0721 01:59:31.725991    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f7bbe3-2504-451d-9a3c-c3f77faae16f" path="/var/lib/kubelet/pods/88f7bbe3-2504-451d-9a3c-c3f77faae16f/volumes"
Jul 21 02:00:00.141059 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.141024    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb"]
Jul 21 02:00:00.141488 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.141334    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f7bbe3-2504-451d-9a3c-c3f77faae16f" containerName="main"
Jul 21 02:00:00.141488 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.141347    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f7bbe3-2504-451d-9a3c-c3f77faae16f" containerName="main"
Jul 21 02:00:00.141488 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.141410    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f7bbe3-2504-451d-9a3c-c3f77faae16f" containerName="main"
Jul 21 02:00:00.144082 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.144068    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb"
Jul 21 02:00:00.146409 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.146389    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-x582z\""
Jul 21 02:00:00.150510 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.150483    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb"]
Jul 21 02:00:00.155157 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.155137    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb"
Jul 21 02:00:00.287947 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.287817    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb"]
Jul 21 02:00:00.290140 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:00:00.290114    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb5a829_4784_4d8f_bff0_c94e298c11a6.slice/crio-bfb176bf0007536f47d6d8482ef024627ff5792e0351f33c93a220f0f9656ee8 WatchSource:0}: Error finding container bfb176bf0007536f47d6d8482ef024627ff5792e0351f33c93a220f0f9656ee8: Status 404 returned error can't find the container with id bfb176bf0007536f47d6d8482ef024627ff5792e0351f33c93a220f0f9656ee8
Jul 21 02:00:00.291937 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.291924    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 02:00:00.770761 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:00.770720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb" event={"ID":"7cb5a829-4784-4d8f-bff0-c94e298c11a6","Type":"ContainerStarted","Data":"bfb176bf0007536f47d6d8482ef024627ff5792e0351f33c93a220f0f9656ee8"}
Jul 21 02:00:03.788068 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:03.788033    2568 generic.go:356] "Generic (PLEG): container finished" podID="7cb5a829-4784-4d8f-bff0-c94e298c11a6" containerID="131c5fa2dc287dd9afadc84c6b560434468f9ea555a3400f71f8b2e27b8c1cb0" exitCode=0
Jul 21 02:00:03.788430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:03.788092    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb" event={"ID":"7cb5a829-4784-4d8f-bff0-c94e298c11a6","Type":"ContainerDied","Data":"131c5fa2dc287dd9afadc84c6b560434468f9ea555a3400f71f8b2e27b8c1cb0"}
Jul 21 02:00:04.916829 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:04.916804    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb"
Jul 21 02:00:05.797446 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:05.797417    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb" event={"ID":"7cb5a829-4784-4d8f-bff0-c94e298c11a6","Type":"ContainerDied","Data":"bfb176bf0007536f47d6d8482ef024627ff5792e0351f33c93a220f0f9656ee8"}
Jul 21 02:00:05.797446 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:05.797436    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743320-l5thb"
Jul 21 02:00:05.797609 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:00:05.797457    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfb176bf0007536f47d6d8482ef024627ff5792e0351f33c93a220f0f9656ee8"
Jul 21 02:03:01.303993 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.303965    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"]
Jul 21 02:03:01.304459 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.304249    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb5a829-4784-4d8f-bff0-c94e298c11a6" containerName="cleanup"
Jul 21 02:03:01.304459 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.304259    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb5a829-4784-4d8f-bff0-c94e298c11a6" containerName="cleanup"
Jul 21 02:03:01.304459 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.304335    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb5a829-4784-4d8f-bff0-c94e298c11a6" containerName="cleanup"
Jul 21 02:03:01.307125 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.307110    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.310238 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.310215    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-604509c9-openshift-default-dockercfg-dwtnb\""
Jul 21 02:03:01.336987 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.336960    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"]
Jul 21 02:03:01.459085 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459049    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-istio-token\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.459250 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459127    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-socket\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.459250 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459153    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-certs\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.459250 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459175    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d64be-a08d-473f-8898-2fad4925641f-istiod-ca-cert\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.459250 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-envoy\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.459250 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459213    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-data\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.459250 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw6nt\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-kube-api-access-dw6nt\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.459479 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d64be-a08d-473f-8898-2fad4925641f-istio-podinfo\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.459479 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.459386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-credential-socket\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560541 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-data\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560541 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560487    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw6nt\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-kube-api-access-dw6nt\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560541 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560516    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d64be-a08d-473f-8898-2fad4925641f-istio-podinfo\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560820 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560570    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-credential-socket\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560820 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560598    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-istio-token\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560820 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560647    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-socket\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560820 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-certs\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560820 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d64be-a08d-473f-8898-2fad4925641f-istiod-ca-cert\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.560820 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560787    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-envoy\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.561118 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.560934    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-data\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.561118 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.561066    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-certs\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.561198 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.561145    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-socket\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.561238 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.561205    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-credential-socket\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.561458 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.561436    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d64be-a08d-473f-8898-2fad4925641f-istiod-ca-cert\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.562939 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.562920    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-envoy\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.563140 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.563115    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d64be-a08d-473f-8898-2fad4925641f-istio-podinfo\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.569573 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.569550    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-istio-token\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.569792 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.569772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw6nt\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-kube-api-access-dw6nt\") pod \"e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") " pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.616906 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.616880    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:01.747177 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.747153    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"]
Jul 21 02:03:01.748966 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:03:01.748938    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0d64be_a08d_473f_8898_2fad4925641f.slice/crio-f2f80d5bb3f9a9727a92d39fe57a01830f258ad29de4e8d150bc5c1b4b0a0020 WatchSource:0}: Error finding container f2f80d5bb3f9a9727a92d39fe57a01830f258ad29de4e8d150bc5c1b4b0a0020: Status 404 returned error can't find the container with id f2f80d5bb3f9a9727a92d39fe57a01830f258ad29de4e8d150bc5c1b4b0a0020
Jul 21 02:03:01.750961 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.750934    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:01.751059 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.751041    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:01.751122 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:01.751098    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:02.592710 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:02.592677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" event={"ID":"7c0d64be-a08d-473f-8898-2fad4925641f","Type":"ContainerStarted","Data":"5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87"}
Jul 21 02:03:02.593081 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:02.592726    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" event={"ID":"7c0d64be-a08d-473f-8898-2fad4925641f","Type":"ContainerStarted","Data":"f2f80d5bb3f9a9727a92d39fe57a01830f258ad29de4e8d150bc5c1b4b0a0020"}
Jul 21 02:03:02.611409 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:02.611365    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" podStartSLOduration=1.611346292 podStartE2EDuration="1.611346292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:02.610269349 +0000 UTC m=+1599.455262944" watchObservedRunningTime="2026-07-21 02:03:02.611346292 +0000 UTC m=+1599.456339887"
Jul 21 02:03:02.617975 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:02.617953    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:02.622636 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:02.622615    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:03.597412 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:03.597339    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:03.598293 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:03.598273    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:04.028967 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.028937    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"]
Jul 21 02:03:04.032097 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.032083    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.034531 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.034507    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-604509c9-serving-cert\""
Jul 21 02:03:04.043874 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.043854    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"]
Jul 21 02:03:04.184123 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.184094    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-maas-api-tls\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.184299 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.184153    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzpgr\" (UniqueName: \"kubernetes.io/projected/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-kube-api-access-vzpgr\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.184299 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.184233    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-openshift-service-ca\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.284876 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.284792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-openshift-service-ca\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.284876 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.284856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-maas-api-tls\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.285121 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.284895    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzpgr\" (UniqueName: \"kubernetes.io/projected/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-kube-api-access-vzpgr\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.285488 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.285466    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-openshift-service-ca\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.287339 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.287302    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-maas-api-tls\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.294103 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.294084    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzpgr\" (UniqueName: \"kubernetes.io/projected/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-kube-api-access-vzpgr\") pod \"maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.342678 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.342645    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:04.474889 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.474863    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"]
Jul 21 02:03:04.477217 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:03:04.477185    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1d011b_bf8a_4e87_97e3_d2bc06ec089c.slice/crio-5f76eabdb580d780ae793f7b931d05b13d1a52683cba81ae25dd156109b6893d WatchSource:0}: Error finding container 5f76eabdb580d780ae793f7b931d05b13d1a52683cba81ae25dd156109b6893d: Status 404 returned error can't find the container with id 5f76eabdb580d780ae793f7b931d05b13d1a52683cba81ae25dd156109b6893d
Jul 21 02:03:04.603428 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:04.603337    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl" event={"ID":"df1d011b-bf8a-4e87-97e3-d2bc06ec089c","Type":"ContainerStarted","Data":"5f76eabdb580d780ae793f7b931d05b13d1a52683cba81ae25dd156109b6893d"}
Jul 21 02:03:05.609301 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:05.609266    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl" event={"ID":"df1d011b-bf8a-4e87-97e3-d2bc06ec089c","Type":"ContainerStarted","Data":"52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794"}
Jul 21 02:03:05.663143 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:05.663090    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl" podStartSLOduration=1.216673538 podStartE2EDuration="1.663070387s" totalImagesPullingTime="446.396849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:05.661944837 +0000 UTC m=+1602.506938432" watchObservedRunningTime="2026-07-21 02:03:05.663070387 +0000 UTC m=+1602.508063981"
Jul 21 02:03:06.620668 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:06.620632    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:12.630494 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:12.630468    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:18.697072 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:18.696649    2568 patch_prober.go:28] interesting pod/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:44538->10.134.0.31:15021: read: connection reset by peer" start-of-body=
Jul 21 02:03:18.697072 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:18.696725    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:44538->10.134.0.31:15021: read: connection reset by peer"
Jul 21 02:03:19.683493 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:19.683463    2568 generic.go:356] "Generic (PLEG): container finished" podID="7c0d64be-a08d-473f-8898-2fad4925641f" containerID="5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87" exitCode=0
Jul 21 02:03:19.683648 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:19.683510    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" event={"ID":"7c0d64be-a08d-473f-8898-2fad4925641f","Type":"ContainerDied","Data":"5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87"}
Jul 21 02:03:19.683857 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:19.683844    2568 scope.go:117] "RemoveContainer" containerID="5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87"
Jul 21 02:03:19.684784 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:19.684756    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:19.684888 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:19.684822    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:19.684888 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:19.684855    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:20.693050 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:20.693000    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" event={"ID":"7c0d64be-a08d-473f-8898-2fad4925641f","Type":"ContainerStarted","Data":"f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772"}
Jul 21 02:03:21.617822 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:21.617777    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:21.618045 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:21.618017    2568 patch_prober.go:28] interesting pod/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 21 02:03:21.618140 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:21.618099    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 21 02:03:22.617261 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:22.617230    2568 patch_prober.go:28] interesting pod/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 21 02:03:22.617658 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:22.617280    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 21 02:03:23.617715 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:23.617681    2568 patch_prober.go:28] interesting pod/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 21 02:03:23.618088 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:23.617730    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 21 02:03:24.618327 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:24.618262    2568 patch_prober.go:28] interesting pod/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 21 02:03:24.618842 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:24.618367    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 21 02:03:25.620639 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:25.620607    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:25.621095 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:25.620998    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:25.621587 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:25.621570    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:40.125695 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.125651    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"]
Jul 21 02:03:40.126274 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.125919    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl" podUID="df1d011b-bf8a-4e87-97e3-d2bc06ec089c" containerName="maas-api" containerID="cri-o://52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794" gracePeriod=30
Jul 21 02:03:40.373186 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.373164    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:40.486496 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.486414    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-maas-api-tls\") pod \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") "
Jul 21 02:03:40.486663 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.486521    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzpgr\" (UniqueName: \"kubernetes.io/projected/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-kube-api-access-vzpgr\") pod \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") "
Jul 21 02:03:40.486663 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.486545    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-openshift-service-ca\") pod \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\" (UID: \"df1d011b-bf8a-4e87-97e3-d2bc06ec089c\") "
Jul 21 02:03:40.486972 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.486946    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df1d011b-bf8a-4e87-97e3-d2bc06ec089c" (UID: "df1d011b-bf8a-4e87-97e3-d2bc06ec089c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:03:40.488602 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.488582    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-kube-api-access-vzpgr" (OuterVolumeSpecName: "kube-api-access-vzpgr") pod "df1d011b-bf8a-4e87-97e3-d2bc06ec089c" (UID: "df1d011b-bf8a-4e87-97e3-d2bc06ec089c"). InnerVolumeSpecName "kube-api-access-vzpgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:03:40.488676 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.488656    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df1d011b-bf8a-4e87-97e3-d2bc06ec089c" (UID: "df1d011b-bf8a-4e87-97e3-d2bc06ec089c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:03:40.588064 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.588036    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzpgr\" (UniqueName: \"kubernetes.io/projected/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-kube-api-access-vzpgr\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:40.588064 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.588060    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-openshift-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:40.588064 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.588069    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df1d011b-bf8a-4e87-97e3-d2bc06ec089c-maas-api-tls\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:40.793239 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.793152    2568 generic.go:356] "Generic (PLEG): container finished" podID="df1d011b-bf8a-4e87-97e3-d2bc06ec089c" containerID="52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794" exitCode=0
Jul 21 02:03:40.793239 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.793191    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"
Jul 21 02:03:40.793239 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.793202    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl" event={"ID":"df1d011b-bf8a-4e87-97e3-d2bc06ec089c","Type":"ContainerDied","Data":"52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794"}
Jul 21 02:03:40.793534 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.793247    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl" event={"ID":"df1d011b-bf8a-4e87-97e3-d2bc06ec089c","Type":"ContainerDied","Data":"5f76eabdb580d780ae793f7b931d05b13d1a52683cba81ae25dd156109b6893d"}
Jul 21 02:03:40.793534 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.793274    2568 scope.go:117] "RemoveContainer" containerID="52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794"
Jul 21 02:03:40.802201 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.802185    2568 scope.go:117] "RemoveContainer" containerID="52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794"
Jul 21 02:03:40.802445 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:03:40.802424    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794\": container with ID starting with 52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794 not found: ID does not exist" containerID="52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794"
Jul 21 02:03:40.802538 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.802450    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794"} err="failed to get container status \"52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794\": rpc error: code = NotFound desc = could not find container \"52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794\": container with ID starting with 52f7682d50529a4275e87074b7b9c9568bed786cf6bbd3463d00150e5af3f794 not found: ID does not exist"
Jul 21 02:03:40.814706 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.814684    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"]
Jul 21 02:03:40.817982 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:40.817959    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-604509c9-76b7bb7dd7-gcbxl"]
Jul 21 02:03:41.725983 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:41.725950    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df1d011b-bf8a-4e87-97e3-d2bc06ec089c" path="/var/lib/kubelet/pods/df1d011b-bf8a-4e87-97e3-d2bc06ec089c/volumes"
Jul 21 02:03:44.830568 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:44.830539    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"]
Jul 21 02:03:44.831018 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:44.830820    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy" containerID="cri-o://f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772" gracePeriod=30
Jul 21 02:03:46.025015 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.024979    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"]
Jul 21 02:03:46.025497 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.025441    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df1d011b-bf8a-4e87-97e3-d2bc06ec089c" containerName="maas-api"
Jul 21 02:03:46.025497 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.025460    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="df1d011b-bf8a-4e87-97e3-d2bc06ec089c" containerName="maas-api"
Jul 21 02:03:46.025614 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.025543    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="df1d011b-bf8a-4e87-97e3-d2bc06ec089c" containerName="maas-api"
Jul 21 02:03:46.028200 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.028177    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.032506 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.032473    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-63c3423d-gw-openshift-default-dockercfg-2jnhm\""
Jul 21 02:03:46.057867 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.057844    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"]
Jul 21 02:03:46.133950 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.133911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-credential-socket\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.133950 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.133951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-certs\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.134193 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.133983    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-token\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.134193 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.134005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbq4n\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-kube-api-access-xbq4n\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.134193 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.134071    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-socket\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.134193 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.134103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-envoy\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.134193 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.134128    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-data\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.134452 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.134231    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-podinfo\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.134452 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.134274    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istiod-ca-cert\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235411 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-podinfo\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235582 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istiod-ca-cert\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235582 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235459    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-credential-socket\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235582 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-certs\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235582 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-token\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235582 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbq4n\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-kube-api-access-xbq4n\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235842 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235582    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-socket\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235842 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-envoy\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235842 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235647    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-data\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235996 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-certs\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.235996 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.235986    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-credential-socket\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.236147 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.236127    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-data\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.236209 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.236151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-socket\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.236301 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.236285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istiod-ca-cert\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.237901 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.237882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-podinfo\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.237901 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.237889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-envoy\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.244904 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.244881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbq4n\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-kube-api-access-xbq4n\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.245004 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.244927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-token\") pod \"e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") " pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.337734 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.337664    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:46.472367 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.472342    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"]
Jul 21 02:03:46.474304 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:03:46.474271    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7d0286_04fa_47cf_bc10_3a9d710f71bb.slice/crio-8e5e3cbbd95ea429592fc9777237aadc1df986b1bfe510f0c6eea00ee72a22c9 WatchSource:0}: Error finding container 8e5e3cbbd95ea429592fc9777237aadc1df986b1bfe510f0c6eea00ee72a22c9: Status 404 returned error can't find the container with id 8e5e3cbbd95ea429592fc9777237aadc1df986b1bfe510f0c6eea00ee72a22c9
Jul 21 02:03:46.476470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.476440    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:46.476554 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.476505    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:46.476554 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.476535    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:03:46.825188 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.825153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" event={"ID":"ac7d0286-04fa-47cf-bc10-3a9d710f71bb","Type":"ContainerStarted","Data":"5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf"}
Jul 21 02:03:46.825391 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.825203    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" event={"ID":"ac7d0286-04fa-47cf-bc10-3a9d710f71bb","Type":"ContainerStarted","Data":"8e5e3cbbd95ea429592fc9777237aadc1df986b1bfe510f0c6eea00ee72a22c9"}
Jul 21 02:03:46.849726 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:46.849680    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" podStartSLOduration=1.849664907 podStartE2EDuration="1.849664907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:03:46.849185233 +0000 UTC m=+1643.694178848" watchObservedRunningTime="2026-07-21 02:03:46.849664907 +0000 UTC m=+1643.694658501"
Jul 21 02:03:47.338540 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:47.338511    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:47.343414 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:47.343391    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:47.830618 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:47.830588    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:47.836774 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:47.836746    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:03:50.082274 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.082252    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:50.169187 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169161    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-envoy\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169191    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d64be-a08d-473f-8898-2fad4925641f-istiod-ca-cert\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169223    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d64be-a08d-473f-8898-2fad4925641f-istio-podinfo\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169253    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-data\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169268    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw6nt\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-kube-api-access-dw6nt\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169303    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-socket\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169343    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-certs\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169630 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169373    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-credential-socket\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169630 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169416    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-istio-token\") pod \"7c0d64be-a08d-473f-8898-2fad4925641f\" (UID: \"7c0d64be-a08d-473f-8898-2fad4925641f\") "
Jul 21 02:03:50.169739 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169672    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c0d64be-a08d-473f-8898-2fad4925641f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:03:50.170008 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169826    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:50.170008 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169956    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:50.170008 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.169974    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:50.170241 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.170222    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:50.171727 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.171699    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:03:50.171819 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.171722    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c0d64be-a08d-473f-8898-2fad4925641f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:03:50.171928 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.171907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:03:50.171966 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.171911    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-kube-api-access-dw6nt" (OuterVolumeSpecName: "kube-api-access-dw6nt") pod "7c0d64be-a08d-473f-8898-2fad4925641f" (UID: "7c0d64be-a08d-473f-8898-2fad4925641f"). InnerVolumeSpecName "kube-api-access-dw6nt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:03:50.270000 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.269975    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d64be-a08d-473f-8898-2fad4925641f-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.270000 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.269996    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.270169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.270004    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw6nt\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-kube-api-access-dw6nt\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.270169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.270015    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.270169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.270023    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.270169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.270032    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.270169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.270039    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d64be-a08d-473f-8898-2fad4925641f-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.270169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.270046    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d64be-a08d-473f-8898-2fad4925641f-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.270169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.270053    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d64be-a08d-473f-8898-2fad4925641f-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:03:50.849210 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.849180    2568 generic.go:356] "Generic (PLEG): container finished" podID="7c0d64be-a08d-473f-8898-2fad4925641f" containerID="f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772" exitCode=0
Jul 21 02:03:50.849388 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.849229    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"
Jul 21 02:03:50.849388 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.849257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" event={"ID":"7c0d64be-a08d-473f-8898-2fad4925641f","Type":"ContainerDied","Data":"f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772"}
Jul 21 02:03:50.849388 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.849331    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk" event={"ID":"7c0d64be-a08d-473f-8898-2fad4925641f","Type":"ContainerDied","Data":"f2f80d5bb3f9a9727a92d39fe57a01830f258ad29de4e8d150bc5c1b4b0a0020"}
Jul 21 02:03:50.849388 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.849365    2568 scope.go:117] "RemoveContainer" containerID="f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772"
Jul 21 02:03:50.857973 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.857956    2568 scope.go:117] "RemoveContainer" containerID="5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87"
Jul 21 02:03:50.865202 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.865182    2568 scope.go:117] "RemoveContainer" containerID="f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772"
Jul 21 02:03:50.865447 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:03:50.865429    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772\": container with ID starting with f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772 not found: ID does not exist" containerID="f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772"
Jul 21 02:03:50.865522 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.865461    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772"} err="failed to get container status \"f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772\": rpc error: code = NotFound desc = could not find container \"f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772\": container with ID starting with f4a9462568b6d9e8898c5aa14ba5bac0a4cd26b209eef3393d47f80f18f90772 not found: ID does not exist"
Jul 21 02:03:50.865522 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.865485    2568 scope.go:117] "RemoveContainer" containerID="5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87"
Jul 21 02:03:50.865706 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:03:50.865688    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87\": container with ID starting with 5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87 not found: ID does not exist" containerID="5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87"
Jul 21 02:03:50.865752 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.865712    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87"} err="failed to get container status \"5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87\": rpc error: code = NotFound desc = could not find container \"5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87\": container with ID starting with 5493164402e08b690f3d015f959b92f871022a34dbe093fe1ce050d2e2bf7f87 not found: ID does not exist"
Jul 21 02:03:50.871664 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.871644    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"]
Jul 21 02:03:50.875367 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:50.875348    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-604509c9-openshift-default-5fdfb77487-p9hvk"]
Jul 21 02:03:51.726442 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:03:51.726414    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" path="/var/lib/kubelet/pods/7c0d64be-a08d-473f-8898-2fad4925641f/volumes"
Jul 21 02:04:02.832693 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:02.832612    2568 patch_prober.go:28] interesting pod/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 21 02:04:02.832693 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:02.832679    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 21 02:04:02.906636 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:02.906608    2568 generic.go:356] "Generic (PLEG): container finished" podID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerID="5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf" exitCode=0
Jul 21 02:04:02.906784 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:02.906649    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" event={"ID":"ac7d0286-04fa-47cf-bc10-3a9d710f71bb","Type":"ContainerDied","Data":"5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf"}
Jul 21 02:04:02.907043 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:02.907025    2568 scope.go:117] "RemoveContainer" containerID="5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf"
Jul 21 02:04:02.907957 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:02.907932    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:02.908046 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:02.908000    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:02.908046 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:02.908033    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:03.913169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:03.913132    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" event={"ID":"ac7d0286-04fa-47cf-bc10-3a9d710f71bb","Type":"ContainerStarted","Data":"98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a"}
Jul 21 02:04:04.338539 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:04.338449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:04:04.338776 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:04.338754    2568 patch_prober.go:28] interesting pod/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 21 02:04:04.338819 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:04.338803    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 21 02:04:05.338407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:05.338371    2568 patch_prober.go:28] interesting pod/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 21 02:04:05.338793 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:05.338426    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 21 02:04:06.338921 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:06.338883    2568 patch_prober.go:28] interesting pod/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 21 02:04:06.339276 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:06.338941    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 21 02:04:07.338132 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:07.338094    2568 patch_prober.go:28] interesting pod/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 21 02:04:07.338340 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:07.338151    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 21 02:04:08.338828 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:08.338791    2568 patch_prober.go:28] interesting pod/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 21 02:04:08.339214 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:08.338848    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 21 02:04:09.342055 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:09.342026    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:04:09.342453 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:09.342410    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:04:09.343107 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:09.343090    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:04:28.605144 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:28.605114    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"]
Jul 21 02:04:28.605600 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:28.605363    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy" containerID="cri-o://98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a" gracePeriod=30
Jul 21 02:04:29.446796 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.446767    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"]
Jul 21 02:04:29.447088 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.447076    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy"
Jul 21 02:04:29.447133 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.447089    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy"
Jul 21 02:04:29.447133 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.447099    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy"
Jul 21 02:04:29.447133 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.447104    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy"
Jul 21 02:04:29.447221 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.447161    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy"
Jul 21 02:04:29.447221 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.447169    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c0d64be-a08d-473f-8898-2fad4925641f" containerName="istio-proxy"
Jul 21 02:04:29.451055 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.451037    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.453778 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.453755    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-352dc19c-openshift-default-dockercfg-ddn2l\""
Jul 21 02:04:29.460131 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.460107    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"]
Jul 21 02:04:29.491678 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.491651    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-socket\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.491812 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.491715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-certs\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.491812 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.491784    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-data\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.491930 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.491842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-token\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.491930 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.491884    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-podinfo\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.492077 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.491944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-credential-socket\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.492077 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.491969    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jvzf\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-kube-api-access-9jvzf\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.492077 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.492002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-envoy\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.492077 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.492052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfd8305-9be9-4828-904b-41a5b3a279e4-istiod-ca-cert\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.592846 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.592806    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-credential-socket\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593003 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.592853    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jvzf\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-kube-api-access-9jvzf\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593003 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.592883    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-envoy\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593003 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.592912    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfd8305-9be9-4828-904b-41a5b3a279e4-istiod-ca-cert\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593003 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.592953    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-socket\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593003 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-certs\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593251 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593035    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-data\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593251 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-token\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593251 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-podinfo\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593432 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-credential-socket\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593487 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593441    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-certs\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593487 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593465    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-socket\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593557 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-data\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.593764 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.593744    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfd8305-9be9-4828-904b-41a5b3a279e4-istiod-ca-cert\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.595334 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.595300    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-envoy\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.595402 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.595373    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-podinfo\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.603039 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.603015    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-token\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.603132 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.603077    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jvzf\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-kube-api-access-9jvzf\") pod \"e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") " pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.762419 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.762351    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:29.892757 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.892730    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"]
Jul 21 02:04:29.893894 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:04:29.893868    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfd8305_9be9_4828_904b_41a5b3a279e4.slice/crio-13b17059c4550e5e79d89d70e364da02b8ed4780e2b650eb5e4b921e62f1918b WatchSource:0}: Error finding container 13b17059c4550e5e79d89d70e364da02b8ed4780e2b650eb5e4b921e62f1918b: Status 404 returned error can't find the container with id 13b17059c4550e5e79d89d70e364da02b8ed4780e2b650eb5e4b921e62f1918b
Jul 21 02:04:29.895812 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.895784    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:29.895885 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.895847    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:29.895885 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:29.895877    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:30.040232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:30.040153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" event={"ID":"acfd8305-9be9-4828-904b-41a5b3a279e4","Type":"ContainerStarted","Data":"95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce"}
Jul 21 02:04:30.040232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:30.040209    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" event={"ID":"acfd8305-9be9-4828-904b-41a5b3a279e4","Type":"ContainerStarted","Data":"13b17059c4550e5e79d89d70e364da02b8ed4780e2b650eb5e4b921e62f1918b"}
Jul 21 02:04:30.059585 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:30.059536    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" podStartSLOduration=1.059521334 podStartE2EDuration="1.059521334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:30.057837496 +0000 UTC m=+1686.902831093" watchObservedRunningTime="2026-07-21 02:04:30.059521334 +0000 UTC m=+1686.904514928"
Jul 21 02:04:30.763270 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:30.763239    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:30.767943 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:30.767922    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:31.045883 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.045793    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:31.046581 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.046563    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:31.606878 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.606845    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"]
Jul 21 02:04:31.610129 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.610111    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:31.612275 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.612256    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-352dc19c-serving-cert\""
Jul 21 02:04:31.620359 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.620337    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"]
Jul 21 02:04:31.711757 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.711726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1936f12e-2e7e-4a73-970a-8e7f3b676e22-openshift-service-ca\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:31.711953 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.711790    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvck4\" (UniqueName: \"kubernetes.io/projected/1936f12e-2e7e-4a73-970a-8e7f3b676e22-kube-api-access-bvck4\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:31.711953 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.711856    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:31.812840 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.812814    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:31.813241 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.812862    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1936f12e-2e7e-4a73-970a-8e7f3b676e22-openshift-service-ca\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:31.813241 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.812897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvck4\" (UniqueName: \"kubernetes.io/projected/1936f12e-2e7e-4a73-970a-8e7f3b676e22-kube-api-access-bvck4\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:31.813241 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:04:31.812947    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-serving-cert: secret "maas-api-e2e-ait-352dc19c-serving-cert" not found
Jul 21 02:04:31.813241 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:04:31.813004    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls podName:1936f12e-2e7e-4a73-970a-8e7f3b676e22 nodeName:}" failed. No retries permitted until 2026-07-21 02:04:32.312988146 +0000 UTC m=+1689.157981719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls") pod "maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7" (UID: "1936f12e-2e7e-4a73-970a-8e7f3b676e22") : secret "maas-api-e2e-ait-352dc19c-serving-cert" not found
Jul 21 02:04:31.813669 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.813647    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1936f12e-2e7e-4a73-970a-8e7f3b676e22-openshift-service-ca\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:31.821708 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:31.821690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvck4\" (UniqueName: \"kubernetes.io/projected/1936f12e-2e7e-4a73-970a-8e7f3b676e22-kube-api-access-bvck4\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:32.318776 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:32.318741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:32.321188 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:32.321168    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls\") pod \"maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:32.521554 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:32.521522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:32.650359 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:32.650333    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"]
Jul 21 02:04:32.651952 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:04:32.651918    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1936f12e_2e7e_4a73_970a_8e7f3b676e22.slice/crio-61448b7d1fdc5928514b7cf3d47760157c10ebd37a6a9c833b054aa0f914ba93 WatchSource:0}: Error finding container 61448b7d1fdc5928514b7cf3d47760157c10ebd37a6a9c833b054aa0f914ba93: Status 404 returned error can't find the container with id 61448b7d1fdc5928514b7cf3d47760157c10ebd37a6a9c833b054aa0f914ba93
Jul 21 02:04:33.055155 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.055119    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7" event={"ID":"1936f12e-2e7e-4a73-970a-8e7f3b676e22","Type":"ContainerStarted","Data":"61448b7d1fdc5928514b7cf3d47760157c10ebd37a6a9c833b054aa0f914ba93"}
Jul 21 02:04:33.870548 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.870493    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:04:33.931708 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931681    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istiod-ca-cert\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.931873 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931720    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-credential-socket\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.931873 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931741    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-envoy\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.931873 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931775    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-certs\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.931873 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931808    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-socket\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.931873 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931827    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-data\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.931873 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931853    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-token\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.932192 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931878    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbq4n\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-kube-api-access-xbq4n\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.932192 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931925    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-podinfo\") pod \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\" (UID: \"ac7d0286-04fa-47cf-bc10-3a9d710f71bb\") "
Jul 21 02:04:33.932192 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.931952    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:04:33.932192 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.932074    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:04:33.932417 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.932222    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:33.932417 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.932326    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:04:33.932417 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.932350    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:33.932538 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.932496    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:04:33.933030 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.933003    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:04:33.934203 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.934179    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:04:33.934333 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.934257    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:04:33.934407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.934350    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:04:33.934523 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:33.934507    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-kube-api-access-xbq4n" (OuterVolumeSpecName: "kube-api-access-xbq4n") pod "ac7d0286-04fa-47cf-bc10-3a9d710f71bb" (UID: "ac7d0286-04fa-47cf-bc10-3a9d710f71bb"). InnerVolumeSpecName "kube-api-access-xbq4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:04:34.032898 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.032872    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:34.032898 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.032897    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:34.033081 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.032908    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:34.033081 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.032916    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:34.033081 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.032925    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:34.033081 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.032933    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbq4n\" (UniqueName: \"kubernetes.io/projected/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-kube-api-access-xbq4n\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:34.033081 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.032943    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac7d0286-04fa-47cf-bc10-3a9d710f71bb-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:04:34.062438 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.062406    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7" event={"ID":"1936f12e-2e7e-4a73-970a-8e7f3b676e22","Type":"ContainerStarted","Data":"8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1"}
Jul 21 02:04:34.062813 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.062465    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:34.063994 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.063972    2568 generic.go:356] "Generic (PLEG): container finished" podID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerID="98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a" exitCode=0
Jul 21 02:04:34.064094 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.064013    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"
Jul 21 02:04:34.064094 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.064045    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" event={"ID":"ac7d0286-04fa-47cf-bc10-3a9d710f71bb","Type":"ContainerDied","Data":"98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a"}
Jul 21 02:04:34.064094 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.064090    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf" event={"ID":"ac7d0286-04fa-47cf-bc10-3a9d710f71bb","Type":"ContainerDied","Data":"8e5e3cbbd95ea429592fc9777237aadc1df986b1bfe510f0c6eea00ee72a22c9"}
Jul 21 02:04:34.064197 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.064120    2568 scope.go:117] "RemoveContainer" containerID="98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a"
Jul 21 02:04:34.074040 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.074019    2568 scope.go:117] "RemoveContainer" containerID="5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf"
Jul 21 02:04:34.081070 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.081012    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7" podStartSLOduration=2.642812753 podStartE2EDuration="3.08099799s" totalImagesPullingTime="438.185237ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:04:34.07853946 +0000 UTC m=+1690.923533082" watchObservedRunningTime="2026-07-21 02:04:34.08099799 +0000 UTC m=+1690.925991618"
Jul 21 02:04:34.083007 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.082989    2568 scope.go:117] "RemoveContainer" containerID="98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a"
Jul 21 02:04:34.083262 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:04:34.083235    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a\": container with ID starting with 98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a not found: ID does not exist" containerID="98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a"
Jul 21 02:04:34.083389 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.083271    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a"} err="failed to get container status \"98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a\": rpc error: code = NotFound desc = could not find container \"98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a\": container with ID starting with 98fc154faae3f9c3303274b0c745e9ac474cb7dfae1b8a8ecd5a80b0372eb93a not found: ID does not exist"
Jul 21 02:04:34.083389 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.083292    2568 scope.go:117] "RemoveContainer" containerID="5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf"
Jul 21 02:04:34.083546 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:04:34.083529    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf\": container with ID starting with 5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf not found: ID does not exist" containerID="5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf"
Jul 21 02:04:34.083587 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.083551    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf"} err="failed to get container status \"5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf\": rpc error: code = NotFound desc = could not find container \"5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf\": container with ID starting with 5f5f22b70988700119719c985523db9ad8e3f7dd1f7ccbe8fb41996f80b984cf not found: ID does not exist"
Jul 21 02:04:34.092226 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.092206    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"]
Jul 21 02:04:34.096204 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:34.096184    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-63c3423d-gw-openshift-default-5b746c7cc9-qnzqf"]
Jul 21 02:04:35.726023 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:35.725990    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" path="/var/lib/kubelet/pods/ac7d0286-04fa-47cf-bc10-3a9d710f71bb/volumes"
Jul 21 02:04:40.076201 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:40.076171    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:04:46.155437 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:46.154794    2568 patch_prober.go:28] interesting pod/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:38420->10.134.0.34:15021: read: connection reset by peer" start-of-body=
Jul 21 02:04:46.155437 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:46.154876    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:38420->10.134.0.34:15021: read: connection reset by peer"
Jul 21 02:04:47.136138 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:47.136104    2568 generic.go:356] "Generic (PLEG): container finished" podID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerID="95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce" exitCode=0
Jul 21 02:04:47.136357 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:47.136183    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" event={"ID":"acfd8305-9be9-4828-904b-41a5b3a279e4","Type":"ContainerDied","Data":"95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce"}
Jul 21 02:04:47.136600 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:47.136582    2568 scope.go:117] "RemoveContainer" containerID="95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce"
Jul 21 02:04:47.137518 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:47.137494    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:47.137577 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:47.137557    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:47.137612 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:47.137592    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:04:48.143014 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:48.142981    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" event={"ID":"acfd8305-9be9-4828-904b-41a5b3a279e4","Type":"ContainerStarted","Data":"e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3"}
Jul 21 02:04:48.763339 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:48.763298    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:48.763602 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:48.763578    2568 patch_prober.go:28] interesting pod/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 21 02:04:48.763647 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:48.763630    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 21 02:04:49.763521 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:49.763488    2568 patch_prober.go:28] interesting pod/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 21 02:04:49.763927 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:49.763541    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 21 02:04:50.763202 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:50.763156    2568 patch_prober.go:28] interesting pod/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 21 02:04:50.763366 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:50.763218    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 21 02:04:51.763139 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:51.763099    2568 patch_prober.go:28] interesting pod/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 21 02:04:51.763594 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:51.763157    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 21 02:04:52.766374 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:52.766343    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:52.766826 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:52.766603    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:04:52.767230 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:04:52.767214    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:05:07.709546 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:07.709516    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"]
Jul 21 02:05:07.710058 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:07.709736    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7" podUID="1936f12e-2e7e-4a73-970a-8e7f3b676e22" containerName="maas-api" containerID="cri-o://8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1" gracePeriod=30
Jul 21 02:05:07.952041 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:07.952019    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:05:08.126427 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.126400    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvck4\" (UniqueName: \"kubernetes.io/projected/1936f12e-2e7e-4a73-970a-8e7f3b676e22-kube-api-access-bvck4\") pod \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") "
Jul 21 02:05:08.126579 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.126475    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1936f12e-2e7e-4a73-970a-8e7f3b676e22-openshift-service-ca\") pod \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") "
Jul 21 02:05:08.126579 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.126554    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls\") pod \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\" (UID: \"1936f12e-2e7e-4a73-970a-8e7f3b676e22\") "
Jul 21 02:05:08.126914 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.126885    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1936f12e-2e7e-4a73-970a-8e7f3b676e22-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1936f12e-2e7e-4a73-970a-8e7f3b676e22" (UID: "1936f12e-2e7e-4a73-970a-8e7f3b676e22"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:05:08.128542 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.128520    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1936f12e-2e7e-4a73-970a-8e7f3b676e22" (UID: "1936f12e-2e7e-4a73-970a-8e7f3b676e22"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:05:08.128636 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.128574    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1936f12e-2e7e-4a73-970a-8e7f3b676e22-kube-api-access-bvck4" (OuterVolumeSpecName: "kube-api-access-bvck4") pod "1936f12e-2e7e-4a73-970a-8e7f3b676e22" (UID: "1936f12e-2e7e-4a73-970a-8e7f3b676e22"). InnerVolumeSpecName "kube-api-access-bvck4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:08.227503 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.227477    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1936f12e-2e7e-4a73-970a-8e7f3b676e22-maas-api-tls\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:08.227503 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.227499    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvck4\" (UniqueName: \"kubernetes.io/projected/1936f12e-2e7e-4a73-970a-8e7f3b676e22-kube-api-access-bvck4\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:08.227660 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.227510    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1936f12e-2e7e-4a73-970a-8e7f3b676e22-openshift-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:08.239077 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.239053    2568 generic.go:356] "Generic (PLEG): container finished" podID="1936f12e-2e7e-4a73-970a-8e7f3b676e22" containerID="8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1" exitCode=0
Jul 21 02:05:08.239196 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.239095    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"
Jul 21 02:05:08.239196 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.239138    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7" event={"ID":"1936f12e-2e7e-4a73-970a-8e7f3b676e22","Type":"ContainerDied","Data":"8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1"}
Jul 21 02:05:08.239196 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.239191    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7" event={"ID":"1936f12e-2e7e-4a73-970a-8e7f3b676e22","Type":"ContainerDied","Data":"61448b7d1fdc5928514b7cf3d47760157c10ebd37a6a9c833b054aa0f914ba93"}
Jul 21 02:05:08.239293 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.239213    2568 scope.go:117] "RemoveContainer" containerID="8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1"
Jul 21 02:05:08.248570 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.248555    2568 scope.go:117] "RemoveContainer" containerID="8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1"
Jul 21 02:05:08.248801 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:05:08.248785    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1\": container with ID starting with 8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1 not found: ID does not exist" containerID="8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1"
Jul 21 02:05:08.248854 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.248808    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1"} err="failed to get container status \"8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1\": rpc error: code = NotFound desc = could not find container \"8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1\": container with ID starting with 8eb5caf9387914ab4469a8a6d8ddc2773be9faf257dc4bd3693b9819ca3720c1 not found: ID does not exist"
Jul 21 02:05:08.260159 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.260132    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"]
Jul 21 02:05:08.264252 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:08.264231    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-352dc19c-5f6fbd5cd7-845j7"]
Jul 21 02:05:09.726421 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:09.726393    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1936f12e-2e7e-4a73-970a-8e7f3b676e22" path="/var/lib/kubelet/pods/1936f12e-2e7e-4a73-970a-8e7f3b676e22/volumes"
Jul 21 02:05:13.590854 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:13.590819    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"]
Jul 21 02:05:13.591230 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:13.591108    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy" containerID="cri-o://e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3" gracePeriod=30
Jul 21 02:05:14.369701 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.369667    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"]
Jul 21 02:05:14.370103 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.370088    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy"
Jul 21 02:05:14.370150 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.370105    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy"
Jul 21 02:05:14.370150 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.370113    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1936f12e-2e7e-4a73-970a-8e7f3b676e22" containerName="maas-api"
Jul 21 02:05:14.370150 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.370118    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1936f12e-2e7e-4a73-970a-8e7f3b676e22" containerName="maas-api"
Jul 21 02:05:14.370150 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.370146    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy"
Jul 21 02:05:14.370271 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.370156    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy"
Jul 21 02:05:14.370271 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.370230    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy"
Jul 21 02:05:14.370271 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.370239    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1936f12e-2e7e-4a73-970a-8e7f3b676e22" containerName="maas-api"
Jul 21 02:05:14.374839 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.374821    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.377379 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.377353    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8d4fc276-openshift-default-dockercfg-m79pl\""
Jul 21 02:05:14.386235 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.386212    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"]
Jul 21 02:05:14.473361 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473324    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gc4n\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-kube-api-access-2gc4n\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.473529 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473380    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-credential-socket\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.473529 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461319d-5a70-46b5-a663-6d67a2eb634f-istiod-ca-cert\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.473529 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-envoy\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.473529 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473454    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-certs\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.473529 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473480    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-token\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.473529 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-podinfo\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.473740 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473539    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-socket\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.473740 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.473563    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-data\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.573928 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.573891    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-credential-socket\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.573928 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.573928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461319d-5a70-46b5-a663-6d67a2eb634f-istiod-ca-cert\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574184 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.573954    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-envoy\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574184 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.573978    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-certs\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574184 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.573993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-token\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574184 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574012    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-podinfo\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574408 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-socket\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574408 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-data\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574408 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574396    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gc4n\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-kube-api-access-2gc4n\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574566 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574484    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-credential-socket\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574623 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574578    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-certs\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574700 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574676    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-socket\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574796 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574745    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-data\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.574954 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.574930    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461319d-5a70-46b5-a663-6d67a2eb634f-istiod-ca-cert\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.576488 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.576451    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-envoy\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.576615 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.576585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-podinfo\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.581255 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.581233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-token\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.581467 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.581447    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gc4n\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-kube-api-access-2gc4n\") pod \"e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") " pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.685206 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.685137    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:14.814963 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.814934    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"]
Jul 21 02:05:14.817971 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:05:14.817943    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0461319d_5a70_46b5_a663_6d67a2eb634f.slice/crio-42ebab6106b2b85abb4ecb3eca312f6a89636c63b6881c5bc75bf8031d9c9bfd WatchSource:0}: Error finding container 42ebab6106b2b85abb4ecb3eca312f6a89636c63b6881c5bc75bf8031d9c9bfd: Status 404 returned error can't find the container with id 42ebab6106b2b85abb4ecb3eca312f6a89636c63b6881c5bc75bf8031d9c9bfd
Jul 21 02:05:14.820025 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.819991    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:05:14.820111 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.820054    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:05:14.820111 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:14.820081    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:05:15.274300 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:15.274263    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" event={"ID":"0461319d-5a70-46b5-a663-6d67a2eb634f","Type":"ContainerStarted","Data":"44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12"}
Jul 21 02:05:15.274501 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:15.274349    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" event={"ID":"0461319d-5a70-46b5-a663-6d67a2eb634f","Type":"ContainerStarted","Data":"42ebab6106b2b85abb4ecb3eca312f6a89636c63b6881c5bc75bf8031d9c9bfd"}
Jul 21 02:05:15.293487 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:15.293433    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" podStartSLOduration=1.293415163 podStartE2EDuration="1.293415163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:05:15.292562091 +0000 UTC m=+1732.137555696" watchObservedRunningTime="2026-07-21 02:05:15.293415163 +0000 UTC m=+1732.138408759"
Jul 21 02:05:15.685536 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:15.685511    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:15.690288 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:15.690264    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:16.279283 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.279258    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:16.280167 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.280151    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:16.712860 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.712821    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"]
Jul 21 02:05:16.713331 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.713303    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac7d0286-04fa-47cf-bc10-3a9d710f71bb" containerName="istio-proxy"
Jul 21 02:05:16.716435 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.716414    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:16.718731 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.718702    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8d4fc276-serving-cert\""
Jul 21 02:05:16.726493 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.726464    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"]
Jul 21 02:05:16.788793 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.788762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ksr\" (UniqueName: \"kubernetes.io/projected/4d345546-70d8-4341-8acc-e5e68e8047e9-kube-api-access-j9ksr\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:16.788961 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.788812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:16.788961 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.788849    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d345546-70d8-4341-8acc-e5e68e8047e9-openshift-service-ca\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:16.889723 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.889689    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d345546-70d8-4341-8acc-e5e68e8047e9-openshift-service-ca\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:16.889897 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.889739    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ksr\" (UniqueName: \"kubernetes.io/projected/4d345546-70d8-4341-8acc-e5e68e8047e9-kube-api-access-j9ksr\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:16.889897 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.889781    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:16.889897 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:05:16.889883    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-serving-cert: secret "maas-api-e2e-derive-8d4fc276-serving-cert" not found
Jul 21 02:05:16.890000 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:05:16.889946    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls podName:4d345546-70d8-4341-8acc-e5e68e8047e9 nodeName:}" failed. No retries permitted until 2026-07-21 02:05:17.389928192 +0000 UTC m=+1734.234921766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls") pod "maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg" (UID: "4d345546-70d8-4341-8acc-e5e68e8047e9") : secret "maas-api-e2e-derive-8d4fc276-serving-cert" not found
Jul 21 02:05:16.890293 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.890277    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d345546-70d8-4341-8acc-e5e68e8047e9-openshift-service-ca\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:16.902140 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:16.902119    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ksr\" (UniqueName: \"kubernetes.io/projected/4d345546-70d8-4341-8acc-e5e68e8047e9-kube-api-access-j9ksr\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:17.394733 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:17.394702    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:17.396976 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:17.396957    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls\") pod \"maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:17.627779 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:17.627746    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:17.760039 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:17.759999    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"]
Jul 21 02:05:17.762725 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:05:17.762693    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d345546_70d8_4341_8acc_e5e68e8047e9.slice/crio-9502e4bd9fbb54306d433efd3cd627fff77868b5c884ef424bc92d39fd9bc282 WatchSource:0}: Error finding container 9502e4bd9fbb54306d433efd3cd627fff77868b5c884ef424bc92d39fd9bc282: Status 404 returned error can't find the container with id 9502e4bd9fbb54306d433efd3cd627fff77868b5c884ef424bc92d39fd9bc282
Jul 21 02:05:17.764208 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:17.764190    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 02:05:18.289802 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.289774    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg" event={"ID":"4d345546-70d8-4341-8acc-e5e68e8047e9","Type":"ContainerStarted","Data":"eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c"}
Jul 21 02:05:18.289930 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.289826    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg" event={"ID":"4d345546-70d8-4341-8acc-e5e68e8047e9","Type":"ContainerStarted","Data":"9502e4bd9fbb54306d433efd3cd627fff77868b5c884ef424bc92d39fd9bc282"}
Jul 21 02:05:18.290138 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.290117    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:18.307101 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.307061    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg" podStartSLOduration=1.9102091780000001 podStartE2EDuration="2.307045832s" totalImagesPullingTime="396.836654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:05:18.305744531 +0000 UTC m=+1735.150738127" watchObservedRunningTime="2026-07-21 02:05:18.307045832 +0000 UTC m=+1735.152039427"
Jul 21 02:05:18.834093 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.834070    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:05:18.904035 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904005    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-credential-socket\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904177 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904059    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-envoy\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904177 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904088    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfd8305-9be9-4828-904b-41a5b3a279e4-istiod-ca-cert\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904177 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904112    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-data\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904177 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904135    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-socket\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904424 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904233    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-podinfo\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904424 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904253    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:18.904424 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904283    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jvzf\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-kube-api-access-9jvzf\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904424 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904336    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-certs\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904456    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:18.904616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904471    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-token\") pod \"acfd8305-9be9-4828-904b-41a5b3a279e4\" (UID: \"acfd8305-9be9-4828-904b-41a5b3a279e4\") "
Jul 21 02:05:18.904616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904594    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:18.904775 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904613    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acfd8305-9be9-4828-904b-41a5b3a279e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:05:18.904775 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904758    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:18.904861 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904778    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:18.904861 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904791    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:18.904861 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.904807    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acfd8305-9be9-4828-904b-41a5b3a279e4-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:18.905154 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.905131    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:18.906559 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.906526    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-kube-api-access-9jvzf" (OuterVolumeSpecName: "kube-api-access-9jvzf") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "kube-api-access-9jvzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:18.906650 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.906588    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:05:18.906823 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.906798    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:18.906910 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:18.906844    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acfd8305-9be9-4828-904b-41a5b3a279e4" (UID: "acfd8305-9be9-4828-904b-41a5b3a279e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:05:19.005161 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.005139    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:19.005161 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.005157    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:19.005161 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.005165    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:19.005368 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.005173    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acfd8305-9be9-4828-904b-41a5b3a279e4-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:19.005368 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.005180    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jvzf\" (UniqueName: \"kubernetes.io/projected/acfd8305-9be9-4828-904b-41a5b3a279e4-kube-api-access-9jvzf\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:19.296603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.296514    2568 generic.go:356] "Generic (PLEG): container finished" podID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerID="e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3" exitCode=0
Jul 21 02:05:19.296603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.296568    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"
Jul 21 02:05:19.296603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.296595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" event={"ID":"acfd8305-9be9-4828-904b-41a5b3a279e4","Type":"ContainerDied","Data":"e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3"}
Jul 21 02:05:19.296831 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.296645    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr" event={"ID":"acfd8305-9be9-4828-904b-41a5b3a279e4","Type":"ContainerDied","Data":"13b17059c4550e5e79d89d70e364da02b8ed4780e2b650eb5e4b921e62f1918b"}
Jul 21 02:05:19.296831 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.296666    2568 scope.go:117] "RemoveContainer" containerID="e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3"
Jul 21 02:05:19.305289 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.305271    2568 scope.go:117] "RemoveContainer" containerID="95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce"
Jul 21 02:05:19.312892 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.312877    2568 scope.go:117] "RemoveContainer" containerID="e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3"
Jul 21 02:05:19.313134 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:05:19.313119    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3\": container with ID starting with e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3 not found: ID does not exist" containerID="e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3"
Jul 21 02:05:19.313174 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.313144    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3"} err="failed to get container status \"e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3\": rpc error: code = NotFound desc = could not find container \"e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3\": container with ID starting with e8fa852efa0325258000eca247515552d80aae912b0cbf8b9de029264910daa3 not found: ID does not exist"
Jul 21 02:05:19.313174 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.313160    2568 scope.go:117] "RemoveContainer" containerID="95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce"
Jul 21 02:05:19.313383 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:05:19.313364    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce\": container with ID starting with 95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce not found: ID does not exist" containerID="95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce"
Jul 21 02:05:19.313475 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.313386    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce"} err="failed to get container status \"95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce\": rpc error: code = NotFound desc = could not find container \"95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce\": container with ID starting with 95f463f3d6cd5fe7cd1caeae9c7a72afd2c1e0270a6a45607e0c9a2cc09ae5ce not found: ID does not exist"
Jul 21 02:05:19.318425 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.318405    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"]
Jul 21 02:05:19.321694 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.321675    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-352dc19c-openshift-default-99f87545f-qcwlr"]
Jul 21 02:05:19.725862 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:19.725831    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" path="/var/lib/kubelet/pods/acfd8305-9be9-4828-904b-41a5b3a279e4/volumes"
Jul 21 02:05:24.309663 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:24.309632    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:30.355010 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:30.354932    2568 generic.go:356] "Generic (PLEG): container finished" podID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerID="44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12" exitCode=0
Jul 21 02:05:30.355398 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:30.355002    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" event={"ID":"0461319d-5a70-46b5-a663-6d67a2eb634f","Type":"ContainerDied","Data":"44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12"}
Jul 21 02:05:30.355398 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:30.355380    2568 scope.go:117] "RemoveContainer" containerID="44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12"
Jul 21 02:05:30.356407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:30.356385    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:05:30.356470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:30.356453    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:05:30.356506 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:30.356496    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:05:31.280193 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:31.280156    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:31.362112 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:31.362077    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" event={"ID":"0461319d-5a70-46b5-a663-6d67a2eb634f","Type":"ContainerStarted","Data":"f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb"}
Jul 21 02:05:31.686000 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:31.685967    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:31.687065 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:31.687046    2568 patch_prober.go:28] interesting pod/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 02:05:31.687122 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:31.687102    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 02:05:32.686508 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:32.685996    2568 patch_prober.go:28] interesting pod/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 02:05:32.686508 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:32.686078    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 02:05:33.686363 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:33.686295    2568 patch_prober.go:28] interesting pod/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 02:05:33.686576 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:33.686389    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 02:05:34.685586 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:34.685555    2568 patch_prober.go:28] interesting pod/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 02:05:34.685852 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:34.685826    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 02:05:35.686543 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:35.686501    2568 patch_prober.go:28] interesting pod/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 21 02:05:35.687088 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:35.686567    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 21 02:05:36.689901 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:36.689870    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:36.690287 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:36.690152    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:36.690756 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:36.690739    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:05:51.979068 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:51.979037    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"]
Jul 21 02:05:51.979649 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:51.979282    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg" podUID="4d345546-70d8-4341-8acc-e5e68e8047e9" containerName="maas-api" containerID="cri-o://eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c" gracePeriod=30
Jul 21 02:05:52.226051 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.226019    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:52.278123 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.278064    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls\") pod \"4d345546-70d8-4341-8acc-e5e68e8047e9\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") "
Jul 21 02:05:52.278123 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.278097    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9ksr\" (UniqueName: \"kubernetes.io/projected/4d345546-70d8-4341-8acc-e5e68e8047e9-kube-api-access-j9ksr\") pod \"4d345546-70d8-4341-8acc-e5e68e8047e9\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") "
Jul 21 02:05:52.278331 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.278128    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d345546-70d8-4341-8acc-e5e68e8047e9-openshift-service-ca\") pod \"4d345546-70d8-4341-8acc-e5e68e8047e9\" (UID: \"4d345546-70d8-4341-8acc-e5e68e8047e9\") "
Jul 21 02:05:52.278542 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.278510    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d345546-70d8-4341-8acc-e5e68e8047e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d345546-70d8-4341-8acc-e5e68e8047e9" (UID: "4d345546-70d8-4341-8acc-e5e68e8047e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:05:52.280090 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.280057    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d345546-70d8-4341-8acc-e5e68e8047e9" (UID: "4d345546-70d8-4341-8acc-e5e68e8047e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:05:52.280169 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.280108    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d345546-70d8-4341-8acc-e5e68e8047e9-kube-api-access-j9ksr" (OuterVolumeSpecName: "kube-api-access-j9ksr") pod "4d345546-70d8-4341-8acc-e5e68e8047e9" (UID: "4d345546-70d8-4341-8acc-e5e68e8047e9"). InnerVolumeSpecName "kube-api-access-j9ksr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:05:52.379464 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.379440    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9ksr\" (UniqueName: \"kubernetes.io/projected/4d345546-70d8-4341-8acc-e5e68e8047e9-kube-api-access-j9ksr\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:52.379464 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.379466    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d345546-70d8-4341-8acc-e5e68e8047e9-openshift-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:52.379601 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.379481    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d345546-70d8-4341-8acc-e5e68e8047e9-maas-api-tls\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:05:52.460585 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.460554    2568 generic.go:356] "Generic (PLEG): container finished" podID="4d345546-70d8-4341-8acc-e5e68e8047e9" containerID="eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c" exitCode=0
Jul 21 02:05:52.460716 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.460599    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"
Jul 21 02:05:52.460716 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.460638    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg" event={"ID":"4d345546-70d8-4341-8acc-e5e68e8047e9","Type":"ContainerDied","Data":"eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c"}
Jul 21 02:05:52.460716 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.460687    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg" event={"ID":"4d345546-70d8-4341-8acc-e5e68e8047e9","Type":"ContainerDied","Data":"9502e4bd9fbb54306d433efd3cd627fff77868b5c884ef424bc92d39fd9bc282"}
Jul 21 02:05:52.460716 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.460710    2568 scope.go:117] "RemoveContainer" containerID="eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c"
Jul 21 02:05:52.470446 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.470431    2568 scope.go:117] "RemoveContainer" containerID="eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c"
Jul 21 02:05:52.470697 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:05:52.470680    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c\": container with ID starting with eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c not found: ID does not exist" containerID="eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c"
Jul 21 02:05:52.470749 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.470705    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c"} err="failed to get container status \"eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c\": rpc error: code = NotFound desc = could not find container \"eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c\": container with ID starting with eac4906faeebd6ec99f6f58eddf44a600ad74343e4f1ae2b6a4a1560d72ea88c not found: ID does not exist"
Jul 21 02:05:52.483366 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.483345    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"]
Jul 21 02:05:52.488556 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:52.488538    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8d4fc276-6f646dcf56-7d8bg"]
Jul 21 02:05:53.726675 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:53.726640    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d345546-70d8-4341-8acc-e5e68e8047e9" path="/var/lib/kubelet/pods/4d345546-70d8-4341-8acc-e5e68e8047e9/volumes"
Jul 21 02:05:56.776321 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:56.776276    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"]
Jul 21 02:05:56.776685 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:05:56.776537    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy" containerID="cri-o://f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb" gracePeriod=30
Jul 21 02:06:02.019380 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.019358    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:06:02.163961 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.163936    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-certs\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164120 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.163969    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-socket\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164120 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164030    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-podinfo\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164120 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164063    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-data\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164120 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164094    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-token\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164120 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164119    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-credential-socket\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164406 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164153    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-envoy\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164406 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164195    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461319d-5a70-46b5-a663-6d67a2eb634f-istiod-ca-cert\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164406 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164231    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gc4n\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-kube-api-access-2gc4n\") pod \"0461319d-5a70-46b5-a663-6d67a2eb634f\" (UID: \"0461319d-5a70-46b5-a663-6d67a2eb634f\") "
Jul 21 02:06:02.164406 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164257    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:02.164603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164399    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:02.164603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164516    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.164603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164483    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:02.164603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164535    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.164809 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.164636    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0461319d-5a70-46b5-a663-6d67a2eb634f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:06:02.165049 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.165024    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:02.166232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.166207    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:06:02.166440 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.166419    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-kube-api-access-2gc4n" (OuterVolumeSpecName: "kube-api-access-2gc4n") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "kube-api-access-2gc4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:02.166509 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.166455    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:06:02.166548 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.166515    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0461319d-5a70-46b5-a663-6d67a2eb634f" (UID: "0461319d-5a70-46b5-a663-6d67a2eb634f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:06:02.265028 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.264997    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.265028 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.265023    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.265028 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.265032    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.265198 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.265040    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.265198 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.265050    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0461319d-5a70-46b5-a663-6d67a2eb634f-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.265198 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.265059    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0461319d-5a70-46b5-a663-6d67a2eb634f-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.265198 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.265066    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gc4n\" (UniqueName: \"kubernetes.io/projected/0461319d-5a70-46b5-a663-6d67a2eb634f-kube-api-access-2gc4n\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:06:02.508582 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.508485    2568 generic.go:356] "Generic (PLEG): container finished" podID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerID="f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb" exitCode=0
Jul 21 02:06:02.508582 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.508540    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" event={"ID":"0461319d-5a70-46b5-a663-6d67a2eb634f","Type":"ContainerDied","Data":"f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb"}
Jul 21 02:06:02.508582 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.508556    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"
Jul 21 02:06:02.508858 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.508585    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s" event={"ID":"0461319d-5a70-46b5-a663-6d67a2eb634f","Type":"ContainerDied","Data":"42ebab6106b2b85abb4ecb3eca312f6a89636c63b6881c5bc75bf8031d9c9bfd"}
Jul 21 02:06:02.508858 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.508608    2568 scope.go:117] "RemoveContainer" containerID="f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb"
Jul 21 02:06:02.517438 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.517346    2568 scope.go:117] "RemoveContainer" containerID="44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12"
Jul 21 02:06:02.524753 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.524735    2568 scope.go:117] "RemoveContainer" containerID="f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb"
Jul 21 02:06:02.525008 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:06:02.524990    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb\": container with ID starting with f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb not found: ID does not exist" containerID="f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb"
Jul 21 02:06:02.525054 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.525019    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb"} err="failed to get container status \"f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb\": rpc error: code = NotFound desc = could not find container \"f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb\": container with ID starting with f953eb62adfeb23343c812e739946412947db4758558a0ab77eb08b54242e6fb not found: ID does not exist"
Jul 21 02:06:02.525054 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.525035    2568 scope.go:117] "RemoveContainer" containerID="44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12"
Jul 21 02:06:02.525259 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:06:02.525240    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12\": container with ID starting with 44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12 not found: ID does not exist" containerID="44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12"
Jul 21 02:06:02.525301 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.525264    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12"} err="failed to get container status \"44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12\": rpc error: code = NotFound desc = could not find container \"44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12\": container with ID starting with 44f18d3d10927c580011fdd209c8cc109da1a6b413b3217d13a1e64ca8353a12 not found: ID does not exist"
Jul 21 02:06:02.529800 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.529779    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"]
Jul 21 02:06:02.535217 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:02.535198    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8d4fc276-openshift-default-dfbb9bf5-lqb7s"]
Jul 21 02:06:03.729330 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:06:03.727111    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" path="/var/lib/kubelet/pods/0461319d-5a70-46b5-a663-6d67a2eb634f/volumes"
Jul 21 02:07:42.272806 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.272767    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"]
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273064    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273078    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273089    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273095    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273107    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273113    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273123    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273128    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273137    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d345546-70d8-4341-8acc-e5e68e8047e9" containerName="maas-api"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273142    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d345546-70d8-4341-8acc-e5e68e8047e9" containerName="maas-api"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273192    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273201    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273208    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="acfd8305-9be9-4828-904b-41a5b3a279e4" containerName="istio-proxy"
Jul 21 02:07:42.273268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.273213    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d345546-70d8-4341-8acc-e5e68e8047e9" containerName="maas-api"
Jul 21 02:07:42.275454 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.275438    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.278411 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.278381    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1e560e69-openshift-default-dockercfg-b6bb5\""
Jul 21 02:07:42.303689 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.303660    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"]
Jul 21 02:07:42.367473 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367436    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-token\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.367652 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367512    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-envoy\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.367652 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367536    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67xtk\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-kube-api-access-67xtk\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.367652 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367561    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-credential-socket\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.367652 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367583    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-data\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.367652 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367621    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-socket\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.367652 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-certs\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.367894 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367674    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d7a2661-a639-407e-973e-a6a82ed215f2-istiod-ca-cert\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.367894 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.367702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-podinfo\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468742 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d7a2661-a639-407e-973e-a6a82ed215f2-istiod-ca-cert\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468742 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468742    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-podinfo\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468978 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-token\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468978 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468819    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-envoy\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468978 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468835    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67xtk\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-kube-api-access-67xtk\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468978 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468852    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-credential-socket\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468978 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-data\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468978 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468891    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-socket\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.468978 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.468914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-certs\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.469441 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.469417    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-data\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.469561 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.469537    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d7a2661-a639-407e-973e-a6a82ed215f2-istiod-ca-cert\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.469624 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.469566    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-credential-socket\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.469624 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.469537    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-socket\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.469624 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.469607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-certs\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.471255 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.471234    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-envoy\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.471391 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.471376    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-podinfo\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.478008 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.477984    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-token\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.478325 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.478293    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67xtk\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-kube-api-access-67xtk\") pod \"e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") " pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.590813 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.590754    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:42.722303 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.722279    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"]
Jul 21 02:07:42.723940 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:07:42.723914    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7a2661_a639_407e_973e_a6a82ed215f2.slice/crio-c9a4d6202f33b5b06b11314692ef865b6284350f46aec2b5ee209f322503730b WatchSource:0}: Error finding container c9a4d6202f33b5b06b11314692ef865b6284350f46aec2b5ee209f322503730b: Status 404 returned error can't find the container with id c9a4d6202f33b5b06b11314692ef865b6284350f46aec2b5ee209f322503730b
Jul 21 02:07:42.725955 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.725907    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:07:42.726069 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.725996    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:07:42.726069 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.726044    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:07:42.967435 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.967401    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" event={"ID":"4d7a2661-a639-407e-973e-a6a82ed215f2","Type":"ContainerStarted","Data":"9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727"}
Jul 21 02:07:42.967619 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.967459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" event={"ID":"4d7a2661-a639-407e-973e-a6a82ed215f2","Type":"ContainerStarted","Data":"c9a4d6202f33b5b06b11314692ef865b6284350f46aec2b5ee209f322503730b"}
Jul 21 02:07:42.990401 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:42.990345    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" podStartSLOduration=0.990299815 podStartE2EDuration="990.299815ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:07:42.988639622 +0000 UTC m=+1879.833633218" watchObservedRunningTime="2026-07-21 02:07:42.990299815 +0000 UTC m=+1879.835293411"
Jul 21 02:07:43.591271 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:43.591235    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:43.596234 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:43.596212    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:43.972804 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:43.972775    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:43.973636 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:43.973618    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:07:58.974674 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:58.974635    2568 patch_prober.go:28] interesting pod/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 21 02:07:58.975067 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:58.974700    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 21 02:07:59.050082 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:59.050047    2568 generic.go:356] "Generic (PLEG): container finished" podID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerID="9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727" exitCode=0
Jul 21 02:07:59.050260 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:59.050103    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" event={"ID":"4d7a2661-a639-407e-973e-a6a82ed215f2","Type":"ContainerDied","Data":"9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727"}
Jul 21 02:07:59.050511 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:59.050494    2568 scope.go:117] "RemoveContainer" containerID="9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727"
Jul 21 02:07:59.051463 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:59.051436    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:07:59.051561 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:59.051503    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:07:59.051561 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:07:59.051535    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:08:00.056566 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:00.056530    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" event={"ID":"4d7a2661-a639-407e-973e-a6a82ed215f2","Type":"ContainerStarted","Data":"62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee"}
Jul 21 02:08:00.591356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:00.591239    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:08:00.591577 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:00.591533    2568 patch_prober.go:28] interesting pod/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 21 02:08:00.591933 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:00.591590    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 21 02:08:01.591366 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:01.591301    2568 patch_prober.go:28] interesting pod/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 21 02:08:01.591878 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:01.591392    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 21 02:08:02.591660 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:02.591623    2568 patch_prober.go:28] interesting pod/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 21 02:08:02.592249 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:02.592217    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 21 02:08:03.591438 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:03.591400    2568 patch_prober.go:28] interesting pod/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 21 02:08:03.591725 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:03.591695    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 21 02:08:04.595767 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:04.595739    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:08:04.596207 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:04.596007    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:08:04.596729 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:04.596714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:08:20.685568 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:20.685531    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"]
Jul 21 02:08:20.686139 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:20.685737    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy" containerID="cri-o://62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee" gracePeriod=30
Jul 21 02:08:25.941381 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:25.941356    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:08:26.039078 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.038987    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67xtk\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-kube-api-access-67xtk\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039078 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039031    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-envoy\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039078 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039062    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-podinfo\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039154    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-certs\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039220    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-data\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039245    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-token\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039268    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-credential-socket\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039295    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-socket\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039656 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039443    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:26.039656 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039527    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:26.039656 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039550    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d7a2661-a639-407e-973e-a6a82ed215f2-istiod-ca-cert\") pod \"4d7a2661-a639-407e-973e-a6a82ed215f2\" (UID: \"4d7a2661-a639-407e-973e-a6a82ed215f2\") "
Jul 21 02:08:26.039656 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039646    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:26.039876 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039818    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.039876 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039834    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.039876 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039848    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.039992 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.039897    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d7a2661-a639-407e-973e-a6a82ed215f2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:08:26.040065 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.040044    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:26.041371 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.041348    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-kube-api-access-67xtk" (OuterVolumeSpecName: "kube-api-access-67xtk") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "kube-api-access-67xtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:08:26.041679 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.041648    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:08:26.041679 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.041673    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:08:26.041679 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.041653    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d7a2661-a639-407e-973e-a6a82ed215f2" (UID: "4d7a2661-a639-407e-973e-a6a82ed215f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:08:26.140905 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.140873    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67xtk\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-kube-api-access-67xtk\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.140905 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.140902    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.140905 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.140912    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.141160 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.140919    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.141160 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.140927    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d7a2661-a639-407e-973e-a6a82ed215f2-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.141160 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.140934    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d7a2661-a639-407e-973e-a6a82ed215f2-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:08:26.175406 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.175375    2568 generic.go:356] "Generic (PLEG): container finished" podID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerID="62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee" exitCode=0
Jul 21 02:08:26.175540 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.175427    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"
Jul 21 02:08:26.175540 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.175450    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" event={"ID":"4d7a2661-a639-407e-973e-a6a82ed215f2","Type":"ContainerDied","Data":"62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee"}
Jul 21 02:08:26.175540 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.175507    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6" event={"ID":"4d7a2661-a639-407e-973e-a6a82ed215f2","Type":"ContainerDied","Data":"c9a4d6202f33b5b06b11314692ef865b6284350f46aec2b5ee209f322503730b"}
Jul 21 02:08:26.175540 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.175530    2568 scope.go:117] "RemoveContainer" containerID="62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee"
Jul 21 02:08:26.184445 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.184429    2568 scope.go:117] "RemoveContainer" containerID="9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727"
Jul 21 02:08:26.192548 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.192530    2568 scope.go:117] "RemoveContainer" containerID="62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee"
Jul 21 02:08:26.192795 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:08:26.192774    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee\": container with ID starting with 62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee not found: ID does not exist" containerID="62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee"
Jul 21 02:08:26.192870 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.192808    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee"} err="failed to get container status \"62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee\": rpc error: code = NotFound desc = could not find container \"62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee\": container with ID starting with 62406676fa75c3583cfdb467de0225f48c38d47b09179709fc345a7d1b8b13ee not found: ID does not exist"
Jul 21 02:08:26.192870 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.192832    2568 scope.go:117] "RemoveContainer" containerID="9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727"
Jul 21 02:08:26.193071 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:08:26.193053    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727\": container with ID starting with 9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727 not found: ID does not exist" containerID="9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727"
Jul 21 02:08:26.193108 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.193077    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727"} err="failed to get container status \"9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727\": rpc error: code = NotFound desc = could not find container \"9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727\": container with ID starting with 9271f698a4c9ff8ead04a4c702878f98631277d306484719a3d6eb13b1377727 not found: ID does not exist"
Jul 21 02:08:26.198343 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.198323    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"]
Jul 21 02:08:26.208631 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:26.206359    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1e560e69-openshift-default-647d59b9bc-hcsw6"]
Jul 21 02:08:27.725769 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:27.725735    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" path="/var/lib/kubelet/pods/4d7a2661-a639-407e-973e-a6a82ed215f2/volumes"
Jul 21 02:08:40.750175 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.750141    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"]
Jul 21 02:08:40.750768 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.750475    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy"
Jul 21 02:08:40.750768 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.750488    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy"
Jul 21 02:08:40.750768 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.750498    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy"
Jul 21 02:08:40.750768 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.750504    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy"
Jul 21 02:08:40.750768 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.750554    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0461319d-5a70-46b5-a663-6d67a2eb634f" containerName="istio-proxy"
Jul 21 02:08:40.750768 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.750561    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy"
Jul 21 02:08:40.750768 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.750568    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d7a2661-a639-407e-973e-a6a82ed215f2" containerName="istio-proxy"
Jul 21 02:08:40.755040 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.755018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.757705 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.757682    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f3d1a053-openshift-default-dockercfg-4mmzs\""
Jul 21 02:08:40.766770 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.766748    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"]
Jul 21 02:08:40.862341 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-data\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.862513 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862352    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-istio-token\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.862513 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862454    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-envoy\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.862513 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862504    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-credential-socket\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.862728 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-certs\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.862728 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a21e27c-1872-4c51-8bfd-81720870f437-istiod-ca-cert\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.862819 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862736    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a21e27c-1872-4c51-8bfd-81720870f437-istio-podinfo\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.862819 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862774    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rv8k\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-kube-api-access-5rv8k\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.862819 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.862794    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-socket\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963441 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a21e27c-1872-4c51-8bfd-81720870f437-istio-podinfo\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963441 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rv8k\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-kube-api-access-5rv8k\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963715 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-socket\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963715 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963674    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-data\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963715 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-istio-token\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963883 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963741    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-envoy\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963883 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-credential-socket\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963883 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963810    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-certs\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963883 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a21e27c-1872-4c51-8bfd-81720870f437-istiod-ca-cert\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.963883 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963834    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-socket\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.964136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.963970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-data\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.964136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.964127    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-credential-socket\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.964250 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.964206    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-certs\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.964610 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.964587    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a21e27c-1872-4c51-8bfd-81720870f437-istiod-ca-cert\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.965884 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.965852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-envoy\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.966088 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.966071    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a21e27c-1872-4c51-8bfd-81720870f437-istio-podinfo\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.972718 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.972696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-istio-token\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:40.972813 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:40.972718    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rv8k\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-kube-api-access-5rv8k\") pod \"e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") " pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:41.066401 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:41.066268    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:41.213295 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:41.213265    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"]
Jul 21 02:08:41.213906 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:08:41.213877    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a21e27c_1872_4c51_8bfd_81720870f437.slice/crio-7559ac8374e195d01fad405d8b243c29d245c44dd7c229d9134d52c01ee42910 WatchSource:0}: Error finding container 7559ac8374e195d01fad405d8b243c29d245c44dd7c229d9134d52c01ee42910: Status 404 returned error can't find the container with id 7559ac8374e195d01fad405d8b243c29d245c44dd7c229d9134d52c01ee42910
Jul 21 02:08:41.216156 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:41.216124    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:08:41.216223 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:41.216207    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:08:41.216288 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:41.216274    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:08:41.242099 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:41.242066    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" event={"ID":"3a21e27c-1872-4c51-8bfd-81720870f437","Type":"ContainerStarted","Data":"7559ac8374e195d01fad405d8b243c29d245c44dd7c229d9134d52c01ee42910"}
Jul 21 02:08:42.248436 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:42.248397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" event={"ID":"3a21e27c-1872-4c51-8bfd-81720870f437","Type":"ContainerStarted","Data":"74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5"}
Jul 21 02:08:42.269697 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:42.269642    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" podStartSLOduration=2.269627777 podStartE2EDuration="2.269627777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:08:42.26846632 +0000 UTC m=+1939.113459928" watchObservedRunningTime="2026-07-21 02:08:42.269627777 +0000 UTC m=+1939.114621372"
Jul 21 02:08:43.067350 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:43.067299    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:43.071762 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:43.071740    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:43.253957 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:43.253926    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:43.254872 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:43.254856    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:08:59.295508 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:59.295459    2568 patch_prober.go:28] interesting pod/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 02:08:59.296064 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:08:59.295544    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 02:09:00.340276 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:00.340239    2568 generic.go:356] "Generic (PLEG): container finished" podID="3a21e27c-1872-4c51-8bfd-81720870f437" containerID="74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5" exitCode=0
Jul 21 02:09:00.340711 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:00.340329    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" event={"ID":"3a21e27c-1872-4c51-8bfd-81720870f437","Type":"ContainerDied","Data":"74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5"}
Jul 21 02:09:00.340754 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:00.340732    2568 scope.go:117] "RemoveContainer" containerID="74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5"
Jul 21 02:09:00.341744 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:00.341718    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:09:00.341815 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:00.341799    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:09:00.341857 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:00.341844    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:09:01.347064 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:01.347030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" event={"ID":"3a21e27c-1872-4c51-8bfd-81720870f437","Type":"ContainerStarted","Data":"383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1"}
Jul 21 02:09:02.066977 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:02.066930    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:09:02.067183 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:02.067159    2568 patch_prober.go:28] interesting pod/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 21 02:09:02.067230 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:02.067209    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 21 02:09:03.067578 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:03.067545    2568 patch_prober.go:28] interesting pod/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 21 02:09:03.067979 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:03.067602    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 21 02:09:04.067741 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:04.067698    2568 patch_prober.go:28] interesting pod/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 21 02:09:04.068151 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:04.067771    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 21 02:09:05.067065 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:05.067023    2568 patch_prober.go:28] interesting pod/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 21 02:09:05.067262 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:05.067094    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 21 02:09:06.071148 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:06.071119    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:09:06.071558 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:06.071409    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:09:06.072116 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:09:06.072100    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:10:32.840063 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:32.840028    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"]
Jul 21 02:10:32.840638 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:32.840266    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy" containerID="cri-o://383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1" gracePeriod=30
Jul 21 02:10:36.073910 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:36.073876    2568 patch_prober.go:28] interesting pod/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 02:10:36.074283 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:36.073941    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 02:10:38.089214 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.089193    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:10:38.165005 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.164976    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-certs\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165172 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165011    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a21e27c-1872-4c51-8bfd-81720870f437-istio-podinfo\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165172 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165044    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-data\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165172 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165072    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-credential-socket\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165172 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165098    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-istio-token\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165172 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165163    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rv8k\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-kube-api-access-5rv8k\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165477 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165212    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:10:38.165477 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165260    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-envoy\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165477 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165297    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-socket\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165477 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165354    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a21e27c-1872-4c51-8bfd-81720870f437-istiod-ca-cert\") pod \"3a21e27c-1872-4c51-8bfd-81720870f437\" (UID: \"3a21e27c-1872-4c51-8bfd-81720870f437\") "
Jul 21 02:10:38.165477 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165412    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:10:38.165744 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165598    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:10:38.165744 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165637    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.165744 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165663    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.165907 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.165841    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a21e27c-1872-4c51-8bfd-81720870f437-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:10:38.166057 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.166037    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:10:38.167429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.167399    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:10:38.167528 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.167468    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-kube-api-access-5rv8k" (OuterVolumeSpecName: "kube-api-access-5rv8k") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "kube-api-access-5rv8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:10:38.167678 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.167662    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:10:38.167745 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.167718    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a21e27c-1872-4c51-8bfd-81720870f437-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a21e27c-1872-4c51-8bfd-81720870f437" (UID: "3a21e27c-1872-4c51-8bfd-81720870f437"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:10:38.266181 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.266152    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a21e27c-1872-4c51-8bfd-81720870f437-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.266181 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.266177    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a21e27c-1872-4c51-8bfd-81720870f437-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.266181 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.266186    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.266422 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.266194    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.266422 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.266203    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rv8k\" (UniqueName: \"kubernetes.io/projected/3a21e27c-1872-4c51-8bfd-81720870f437-kube-api-access-5rv8k\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.266422 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.266211    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.266422 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.266219    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a21e27c-1872-4c51-8bfd-81720870f437-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:10:38.812565 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.812529    2568 generic.go:356] "Generic (PLEG): container finished" podID="3a21e27c-1872-4c51-8bfd-81720870f437" containerID="383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1" exitCode=0
Jul 21 02:10:38.812808 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.812591    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"
Jul 21 02:10:38.812808 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.812604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" event={"ID":"3a21e27c-1872-4c51-8bfd-81720870f437","Type":"ContainerDied","Data":"383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1"}
Jul 21 02:10:38.812808 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.812658    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g" event={"ID":"3a21e27c-1872-4c51-8bfd-81720870f437","Type":"ContainerDied","Data":"7559ac8374e195d01fad405d8b243c29d245c44dd7c229d9134d52c01ee42910"}
Jul 21 02:10:38.812808 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.812681    2568 scope.go:117] "RemoveContainer" containerID="383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1"
Jul 21 02:10:38.822075 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.822057    2568 scope.go:117] "RemoveContainer" containerID="74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5"
Jul 21 02:10:38.829753 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.829732    2568 scope.go:117] "RemoveContainer" containerID="383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1"
Jul 21 02:10:38.829988 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:10:38.829972    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1\": container with ID starting with 383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1 not found: ID does not exist" containerID="383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1"
Jul 21 02:10:38.830042 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.829996    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1"} err="failed to get container status \"383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1\": rpc error: code = NotFound desc = could not find container \"383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1\": container with ID starting with 383d3711fab5164120c1757a408fa300fad41f87d1621ee0b1ef1655e78efbc1 not found: ID does not exist"
Jul 21 02:10:38.830042 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.830013    2568 scope.go:117] "RemoveContainer" containerID="74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5"
Jul 21 02:10:38.830229 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:10:38.830211    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5\": container with ID starting with 74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5 not found: ID does not exist" containerID="74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5"
Jul 21 02:10:38.830268 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.830233    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5"} err="failed to get container status \"74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5\": rpc error: code = NotFound desc = could not find container \"74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5\": container with ID starting with 74240a0a147641450781de7f8c236d2bb02e2f997262331ab0893b2c280aadb5 not found: ID does not exist"
Jul 21 02:10:38.835702 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.835682    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"]
Jul 21 02:10:38.839655 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:38.839634    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f3d1a053-openshift-default-576785cff5-khs6g"]
Jul 21 02:10:39.726154 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:10:39.726125    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" path="/var/lib/kubelet/pods/3a21e27c-1872-4c51-8bfd-81720870f437/volumes"
Jul 21 02:11:29.201641 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.201607    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"]
Jul 21 02:11:29.202029 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.201877    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy"
Jul 21 02:11:29.202029 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.201887    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy"
Jul 21 02:11:29.202029 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.201953    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy"
Jul 21 02:11:29.202029 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.201960    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy"
Jul 21 02:11:29.204483 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.204467    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.207512 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.207492    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0eaad6-openshift-default-dockercfg-k8qws\""
Jul 21 02:11:29.254249 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254230    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bvbj\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-kube-api-access-5bvbj\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.254365 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-podinfo\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.254365 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254278    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istiod-ca-cert\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.254365 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254300    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-token\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.254480 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254406    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-data\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.254480 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-socket\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.254480 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-credential-socket\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.254583 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254480    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-certs\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.254583 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.254514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-envoy\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.296625 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.296595    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"]
Jul 21 02:11:29.355208 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355178    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-envoy\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355374 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355215    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bvbj\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-kube-api-access-5bvbj\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355374 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355235    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-podinfo\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355374 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355260    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istiod-ca-cert\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355374 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-token\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355374 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-data\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355639 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355389    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-socket\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355639 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355411    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-credential-socket\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355639 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355451    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-certs\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355796 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-socket\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355796 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-data\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355912 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355799    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-credential-socket\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.355912 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.355871    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-certs\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.356170 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.356151    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istiod-ca-cert\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.357750 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.357731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-podinfo\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.357750 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.357741    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-envoy\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.364973 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.364952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-token\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.365482 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.365464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bvbj\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-kube-api-access-5bvbj\") pod \"e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") " pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.514503 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.514418    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:29.645542 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.645516    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"]
Jul 21 02:11:29.649421 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:11:29.647500    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e75b8d4_a3f4_41a4_840f_df6105fd3096.slice/crio-b1963e51d89cfcbad0cbc88875f47bdea6ca8c62e3ee79eb2255f727a7c66f54 WatchSource:0}: Error finding container b1963e51d89cfcbad0cbc88875f47bdea6ca8c62e3ee79eb2255f727a7c66f54: Status 404 returned error can't find the container with id b1963e51d89cfcbad0cbc88875f47bdea6ca8c62e3ee79eb2255f727a7c66f54
Jul 21 02:11:29.651406 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.651375    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:29.651480 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.651440    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:29.651480 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:29.651468    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:30.042631 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:30.042591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" event={"ID":"1e75b8d4-a3f4-41a4-840f-df6105fd3096","Type":"ContainerStarted","Data":"4f4918e1e6e7ae27592c8e0fe2c347b72f0ad2a3638e2b75f6882a1bca38e048"}
Jul 21 02:11:30.042799 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:30.042654    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" event={"ID":"1e75b8d4-a3f4-41a4-840f-df6105fd3096","Type":"ContainerStarted","Data":"b1963e51d89cfcbad0cbc88875f47bdea6ca8c62e3ee79eb2255f727a7c66f54"}
Jul 21 02:11:30.069455 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:30.069411    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" podStartSLOduration=1.069393858 podStartE2EDuration="1.069393858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:11:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:11:30.068547773 +0000 UTC m=+2106.913541370" watchObservedRunningTime="2026-07-21 02:11:30.069393858 +0000 UTC m=+2106.914387444"
Jul 21 02:11:30.515487 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:30.515447    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:30.520082 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:30.520053    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:31.048479 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:31.048449    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:31.049440 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:31.049418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:37.193248 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.193215    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"]
Jul 21 02:11:37.193644 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.193533    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy"
Jul 21 02:11:37.193644 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.193546    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a21e27c-1872-4c51-8bfd-81720870f437" containerName="istio-proxy"
Jul 21 02:11:37.196565 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.196545    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.199112 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.199093    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-27bb16-openshift-default-dockercfg-2k7pw\""
Jul 21 02:11:37.210976 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.210954    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"]
Jul 21 02:11:37.325946 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.325911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-socket\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.326136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.325980    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-token\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.326136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.326026    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-podinfo\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.326136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.326057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-data\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.326136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.326082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cmqv\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-kube-api-access-6cmqv\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.326136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.326103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-certs\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.326438 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.326171    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-credential-socket\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.326438 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.326256    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-envoy\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.326438 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.326338    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deca2893-0d31-40b1-82ce-b497ea8d646e-istiod-ca-cert\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.426854 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.426824    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-data\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.426854 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.426854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cmqv\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-kube-api-access-6cmqv\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427074 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.426875    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-certs\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427074 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.426896    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-credential-socket\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427074 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.426926    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-envoy\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427074 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.426967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deca2893-0d31-40b1-82ce-b497ea8d646e-istiod-ca-cert\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427074 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.427027    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-socket\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427367 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.427082    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-token\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427367 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.427113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-podinfo\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427367 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.427302    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-data\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427486 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.427383    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-certs\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427486 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.427434    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-credential-socket\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427553 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.427500    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-socket\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.427794 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.427776    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deca2893-0d31-40b1-82ce-b497ea8d646e-istiod-ca-cert\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.429470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.429453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-envoy\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.429562 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.429547    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-podinfo\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.435591 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.435567    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cmqv\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-kube-api-access-6cmqv\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.435591 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.435578    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-token\") pod \"e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") " pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.507005 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.506928    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:37.643678 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.643649    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"]
Jul 21 02:11:37.645488 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:11:37.645462    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeca2893_0d31_40b1_82ce_b497ea8d646e.slice/crio-b24e5e9594497b832fd723257d191cce497f17ea2e37aa94046dbd27a6326b1b WatchSource:0}: Error finding container b24e5e9594497b832fd723257d191cce497f17ea2e37aa94046dbd27a6326b1b: Status 404 returned error can't find the container with id b24e5e9594497b832fd723257d191cce497f17ea2e37aa94046dbd27a6326b1b
Jul 21 02:11:37.647714 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.647684    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:37.647800 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.647755    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:37.647867 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:37.647799    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:38.082536 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:38.082474    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" event={"ID":"deca2893-0d31-40b1-82ce-b497ea8d646e","Type":"ContainerStarted","Data":"a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae"}
Jul 21 02:11:38.082752 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:38.082582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" event={"ID":"deca2893-0d31-40b1-82ce-b497ea8d646e","Type":"ContainerStarted","Data":"b24e5e9594497b832fd723257d191cce497f17ea2e37aa94046dbd27a6326b1b"}
Jul 21 02:11:38.110608 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:38.110557    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" podStartSLOduration=1.110541151 podStartE2EDuration="1.110541151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:11:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:11:38.107505213 +0000 UTC m=+2114.952498810" watchObservedRunningTime="2026-07-21 02:11:38.110541151 +0000 UTC m=+2114.955534746"
Jul 21 02:11:38.507971 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:38.507939    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:38.512621 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:38.512597    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:39.088420 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:39.088376    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:39.093807 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:39.093774    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:40.300908 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.300865    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"]
Jul 21 02:11:40.304742 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.304715    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:40.310217 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.308809    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-27bb16-serving-cert\""
Jul 21 02:11:40.319328 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.319105    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"]
Jul 21 02:11:40.452902 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.452869    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbmxr\" (UniqueName: \"kubernetes.io/projected/609e1b9f-994f-4162-92e6-45dba9a8c9d6-kube-api-access-xbmxr\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:40.453080 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.452907    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:40.453080 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.452937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/609e1b9f-994f-4162-92e6-45dba9a8c9d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:40.553505 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.553419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbmxr\" (UniqueName: \"kubernetes.io/projected/609e1b9f-994f-4162-92e6-45dba9a8c9d6-kube-api-access-xbmxr\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:40.553505 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.553461    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:40.553505 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.553496    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/609e1b9f-994f-4162-92e6-45dba9a8c9d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:40.553734 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:11:40.553611    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-serving-cert: secret "maas-api-e2e-inf-b-27bb16-serving-cert" not found
Jul 21 02:11:40.553734 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:11:40.553672    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls podName:609e1b9f-994f-4162-92e6-45dba9a8c9d6 nodeName:}" failed. No retries permitted until 2026-07-21 02:11:41.053656348 +0000 UTC m=+2117.898649921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls") pod "maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj" (UID: "609e1b9f-994f-4162-92e6-45dba9a8c9d6") : secret "maas-api-e2e-inf-b-27bb16-serving-cert" not found
Jul 21 02:11:40.554139 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.554121    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/609e1b9f-994f-4162-92e6-45dba9a8c9d6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:40.562443 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:40.562418    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbmxr\" (UniqueName: \"kubernetes.io/projected/609e1b9f-994f-4162-92e6-45dba9a8c9d6-kube-api-access-xbmxr\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:41.056370 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:41.056334    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:41.058679 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:41.058662    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls\") pod \"maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:41.227085 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:41.227054    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:41.379842 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:41.379819    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"]
Jul 21 02:11:41.381583 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:11:41.381558    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod609e1b9f_994f_4162_92e6_45dba9a8c9d6.slice/crio-7b2199b8b911d45ea9fc73a6fff75fad9c9c20f8b064d8902ee015f758d0fe39 WatchSource:0}: Error finding container 7b2199b8b911d45ea9fc73a6fff75fad9c9c20f8b064d8902ee015f758d0fe39: Status 404 returned error can't find the container with id 7b2199b8b911d45ea9fc73a6fff75fad9c9c20f8b064d8902ee015f758d0fe39
Jul 21 02:11:41.382917 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:41.382901    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 02:11:42.112637 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:42.112545    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj" event={"ID":"609e1b9f-994f-4162-92e6-45dba9a8c9d6","Type":"ContainerStarted","Data":"4a1abd704e9b7bb1c2ed2b0946dcc3b75cb890e70fb66b87f8af4b35f1ddd18c"}
Jul 21 02:11:42.112637 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:42.112594    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj" event={"ID":"609e1b9f-994f-4162-92e6-45dba9a8c9d6","Type":"ContainerStarted","Data":"7b2199b8b911d45ea9fc73a6fff75fad9c9c20f8b064d8902ee015f758d0fe39"}
Jul 21 02:11:42.112835 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:42.112645    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:42.134629 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:42.132401    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj" podStartSLOduration=1.714719895 podStartE2EDuration="2.132382023s" totalImagesPullingTime="417.662128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:11:42.128521334 +0000 UTC m=+2118.973514948" watchObservedRunningTime="2026-07-21 02:11:42.132382023 +0000 UTC m=+2118.977375617"
Jul 21 02:11:46.050441 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:46.050403    2568 patch_prober.go:28] interesting pod/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 21 02:11:46.050863 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:46.050472    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 21 02:11:46.134393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:46.134360    2568 generic.go:356] "Generic (PLEG): container finished" podID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerID="4f4918e1e6e7ae27592c8e0fe2c347b72f0ad2a3638e2b75f6882a1bca38e048" exitCode=0
Jul 21 02:11:46.134393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:46.134397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" event={"ID":"1e75b8d4-a3f4-41a4-840f-df6105fd3096","Type":"ContainerDied","Data":"4f4918e1e6e7ae27592c8e0fe2c347b72f0ad2a3638e2b75f6882a1bca38e048"}
Jul 21 02:11:46.134793 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:46.134778    2568 scope.go:117] "RemoveContainer" containerID="4f4918e1e6e7ae27592c8e0fe2c347b72f0ad2a3638e2b75f6882a1bca38e048"
Jul 21 02:11:46.135801 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:46.135773    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:46.135860 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:46.135842    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:46.135897 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:46.135873    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:47.142457 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:47.142420    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" event={"ID":"1e75b8d4-a3f4-41a4-840f-df6105fd3096","Type":"ContainerStarted","Data":"ebc90cf2b5495264b9353c620ecb749c02b87eb71083069cce96a3482d993010"}
Jul 21 02:11:47.514918 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:47.514814    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:47.515105 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:47.514947    2568 patch_prober.go:28] interesting pod/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 21 02:11:47.515105 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:47.514992    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 21 02:11:48.130397 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:48.130359    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:11:48.515697 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:48.515667    2568 patch_prober.go:28] interesting pod/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 21 02:11:48.516062 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:48.515728    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 21 02:11:49.515568 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:49.515525    2568 patch_prober.go:28] interesting pod/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 21 02:11:49.515758 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:49.515599    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 21 02:11:50.514822 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:50.514784    2568 patch_prober.go:28] interesting pod/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 21 02:11:50.515015 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:50.514844    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 21 02:11:51.519519 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:51.519490    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:51.519977 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:51.519742    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:51.520502 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:51.520482    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:11:52.167805 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:52.167776    2568 generic.go:356] "Generic (PLEG): container finished" podID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerID="a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae" exitCode=0
Jul 21 02:11:52.168005 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:52.167849    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" event={"ID":"deca2893-0d31-40b1-82ce-b497ea8d646e","Type":"ContainerDied","Data":"a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae"}
Jul 21 02:11:52.168318 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:52.168291    2568 scope.go:117] "RemoveContainer" containerID="a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae"
Jul 21 02:11:52.169157 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:52.169135    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:52.169204 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:52.169195    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:52.169242 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:52.169225    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:11:53.174809 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:53.174775    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" event={"ID":"deca2893-0d31-40b1-82ce-b497ea8d646e","Type":"ContainerStarted","Data":"63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc"}
Jul 21 02:11:53.509433 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:53.509329    2568 patch_prober.go:28] interesting pod/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 21 02:11:53.509433 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:53.509398    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 21 02:11:53.509693 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:53.509671    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:54.088470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:54.088395    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:54.507610 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:54.507566    2568 patch_prober.go:28] interesting pod/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 21 02:11:54.508214 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:54.508179    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 21 02:11:55.508411 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:55.508373    2568 patch_prober.go:28] interesting pod/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 21 02:11:55.509104 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:55.509074    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 21 02:11:56.508080 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:56.508035    2568 patch_prober.go:28] interesting pod/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 21 02:11:56.508294 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:56.508103    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 21 02:11:57.511769 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:57.511735    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:11:57.512870 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:11:57.512849    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:13:42.553739 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:42.553709    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"]
Jul 21 02:13:42.554301 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:42.553906    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy" containerID="cri-o://ebc90cf2b5495264b9353c620ecb749c02b87eb71083069cce96a3482d993010" gracePeriod=30
Jul 21 02:13:47.717120 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.717088    2568 generic.go:356] "Generic (PLEG): container finished" podID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerID="ebc90cf2b5495264b9353c620ecb749c02b87eb71083069cce96a3482d993010" exitCode=0
Jul 21 02:13:47.717537 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.717136    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" event={"ID":"1e75b8d4-a3f4-41a4-840f-df6105fd3096","Type":"ContainerDied","Data":"ebc90cf2b5495264b9353c620ecb749c02b87eb71083069cce96a3482d993010"}
Jul 21 02:13:47.717537 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.717207    2568 scope.go:117] "RemoveContainer" containerID="4f4918e1e6e7ae27592c8e0fe2c347b72f0ad2a3638e2b75f6882a1bca38e048"
Jul 21 02:13:47.798900 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.798872    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:13:47.928345 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928286    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bvbj\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-kube-api-access-5bvbj\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928345 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928350    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-podinfo\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928375    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-certs\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928399    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-credential-socket\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928441    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istiod-ca-cert\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928490    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-token\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928536    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-data\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928576    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-socket\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928911 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928633    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-envoy\") pod \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\" (UID: \"1e75b8d4-a3f4-41a4-840f-df6105fd3096\") "
Jul 21 02:13:47.928911 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928743    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:13:47.929022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928950    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:47.929022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.928940    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:13:47.929173 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.929150    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:13:47.929277 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.929242    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:13:47.929699 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.929666    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:13:47.930698 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.930670    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:13:47.930797 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.930702    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-kube-api-access-5bvbj" (OuterVolumeSpecName: "kube-api-access-5bvbj") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "kube-api-access-5bvbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:13:47.930797 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.930769    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:13:47.930886 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:47.930805    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e75b8d4-a3f4-41a4-840f-df6105fd3096" (UID: "1e75b8d4-a3f4-41a4-840f-df6105fd3096"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:13:48.029390 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.029341    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:48.029390 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.029384    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:48.029390 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.029394    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:48.029390 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.029402    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:48.029390 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.029410    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:48.029700 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.029418    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:48.029700 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.029426    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bvbj\" (UniqueName: \"kubernetes.io/projected/1e75b8d4-a3f4-41a4-840f-df6105fd3096-kube-api-access-5bvbj\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:48.029700 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.029435    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e75b8d4-a3f4-41a4-840f-df6105fd3096-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:48.723255 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.723228    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"
Jul 21 02:13:48.723692 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.723220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727" event={"ID":"1e75b8d4-a3f4-41a4-840f-df6105fd3096","Type":"ContainerDied","Data":"b1963e51d89cfcbad0cbc88875f47bdea6ca8c62e3ee79eb2255f727a7c66f54"}
Jul 21 02:13:48.723692 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.723360    2568 scope.go:117] "RemoveContainer" containerID="ebc90cf2b5495264b9353c620ecb749c02b87eb71083069cce96a3482d993010"
Jul 21 02:13:48.745494 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.745470    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"]
Jul 21 02:13:48.748986 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:48.748963    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0eaad6-openshift-default-c4c8c6bbc-pz727"]
Jul 21 02:13:49.726337 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:49.726295    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" path="/var/lib/kubelet/pods/1e75b8d4-a3f4-41a4-840f-df6105fd3096/volumes"
Jul 21 02:13:53.349068 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.349036    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"]
Jul 21 02:13:53.349558 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.349278    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj" podUID="609e1b9f-994f-4162-92e6-45dba9a8c9d6" containerName="maas-api" containerID="cri-o://4a1abd704e9b7bb1c2ed2b0946dcc3b75cb890e70fb66b87f8af4b35f1ddd18c" gracePeriod=30
Jul 21 02:13:53.748653 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.748618    2568 generic.go:356] "Generic (PLEG): container finished" podID="609e1b9f-994f-4162-92e6-45dba9a8c9d6" containerID="4a1abd704e9b7bb1c2ed2b0946dcc3b75cb890e70fb66b87f8af4b35f1ddd18c" exitCode=0
Jul 21 02:13:53.748789 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.748664    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj" event={"ID":"609e1b9f-994f-4162-92e6-45dba9a8c9d6","Type":"ContainerDied","Data":"4a1abd704e9b7bb1c2ed2b0946dcc3b75cb890e70fb66b87f8af4b35f1ddd18c"}
Jul 21 02:13:53.789192 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.789170    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:13:53.875565 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.875538    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/609e1b9f-994f-4162-92e6-45dba9a8c9d6-openshift-service-ca\") pod \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") "
Jul 21 02:13:53.875692 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.875583    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls\") pod \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") "
Jul 21 02:13:53.875692 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.875616    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbmxr\" (UniqueName: \"kubernetes.io/projected/609e1b9f-994f-4162-92e6-45dba9a8c9d6-kube-api-access-xbmxr\") pod \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\" (UID: \"609e1b9f-994f-4162-92e6-45dba9a8c9d6\") "
Jul 21 02:13:53.875882 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.875859    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/609e1b9f-994f-4162-92e6-45dba9a8c9d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "609e1b9f-994f-4162-92e6-45dba9a8c9d6" (UID: "609e1b9f-994f-4162-92e6-45dba9a8c9d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:13:53.877510 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.877456    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "609e1b9f-994f-4162-92e6-45dba9a8c9d6" (UID: "609e1b9f-994f-4162-92e6-45dba9a8c9d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:13:53.877649 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.877629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/609e1b9f-994f-4162-92e6-45dba9a8c9d6-kube-api-access-xbmxr" (OuterVolumeSpecName: "kube-api-access-xbmxr") pod "609e1b9f-994f-4162-92e6-45dba9a8c9d6" (UID: "609e1b9f-994f-4162-92e6-45dba9a8c9d6"). InnerVolumeSpecName "kube-api-access-xbmxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:13:53.976299 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.976271    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/609e1b9f-994f-4162-92e6-45dba9a8c9d6-openshift-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:53.976299 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.976295    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/609e1b9f-994f-4162-92e6-45dba9a8c9d6-maas-api-tls\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:53.976299 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:53.976320    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbmxr\" (UniqueName: \"kubernetes.io/projected/609e1b9f-994f-4162-92e6-45dba9a8c9d6-kube-api-access-xbmxr\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:13:54.754356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:54.754325    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"
Jul 21 02:13:54.754356 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:54.754341    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj" event={"ID":"609e1b9f-994f-4162-92e6-45dba9a8c9d6","Type":"ContainerDied","Data":"7b2199b8b911d45ea9fc73a6fff75fad9c9c20f8b064d8902ee015f758d0fe39"}
Jul 21 02:13:54.754816 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:54.754400    2568 scope.go:117] "RemoveContainer" containerID="4a1abd704e9b7bb1c2ed2b0946dcc3b75cb890e70fb66b87f8af4b35f1ddd18c"
Jul 21 02:13:54.788932 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:54.788910    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"]
Jul 21 02:13:54.795006 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:54.794984    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-27bb16-5cc4b78bf9-q44rj"]
Jul 21 02:13:55.726052 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:13:55.726022    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="609e1b9f-994f-4162-92e6-45dba9a8c9d6" path="/var/lib/kubelet/pods/609e1b9f-994f-4162-92e6-45dba9a8c9d6/volumes"
Jul 21 02:14:04.726325 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:04.726280    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"]
Jul 21 02:14:04.726724 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:04.726587    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy" containerID="cri-o://63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc" gracePeriod=30
Jul 21 02:14:05.630383 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630343    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"]
Jul 21 02:14:05.630745 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630727    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="609e1b9f-994f-4162-92e6-45dba9a8c9d6" containerName="maas-api"
Jul 21 02:14:05.630835 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630748    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="609e1b9f-994f-4162-92e6-45dba9a8c9d6" containerName="maas-api"
Jul 21 02:14:05.630835 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630773    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy"
Jul 21 02:14:05.630835 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630782    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy"
Jul 21 02:14:05.630835 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630809    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy"
Jul 21 02:14:05.630835 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630817    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy"
Jul 21 02:14:05.631083 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630927    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy"
Jul 21 02:14:05.631083 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630939    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e75b8d4-a3f4-41a4-840f-df6105fd3096" containerName="istio-proxy"
Jul 21 02:14:05.631083 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.630950    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="609e1b9f-994f-4162-92e6-45dba9a8c9d6" containerName="maas-api"
Jul 21 02:14:05.632837 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.632814    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.635355 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.635336    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-91b59b-openshift-default-dockercfg-k6q6j\""
Jul 21 02:14:05.649128 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.649107    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"]
Jul 21 02:14:05.780608 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780575    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-podinfo\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.781022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780625    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-socket\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.781022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-envoy\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.781022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-token\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.781022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780755    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c8nz\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-kube-api-access-5c8nz\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.781022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780795    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-credential-socket\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.781022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-certs\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.781022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780865    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istiod-ca-cert\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.781022 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.780905    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-data\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.881994 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.881904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-data\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.881994 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.881939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-podinfo\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882205 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-socket\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882205 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-envoy\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882346 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882202    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-token\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882346 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882229    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8nz\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-kube-api-access-5c8nz\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882480 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-credential-socket\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882480 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882435    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-socket\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882480 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882458    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-certs\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882631 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istiod-ca-cert\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882716 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882696    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-credential-socket\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882787 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882735    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-certs\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.882787 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.882410    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-data\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.883191 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.883171    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istiod-ca-cert\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.884418 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.884398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-envoy\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.884678 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.884660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-podinfo\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.896726 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.896705    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-token\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.896819 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.896752    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c8nz\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-kube-api-access-5c8nz\") pod \"e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") " pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:05.942891 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:05.942857    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:06.088751 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:06.088724    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"]
Jul 21 02:14:06.089445 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:14:06.089421    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda531a675_a6d4_4eaa_85de_3bf2a8699dcb.slice/crio-6c4a8ff81cd172a1c00c927fc494a245a1e6a84c3d892f9de8926a46af637636 WatchSource:0}: Error finding container 6c4a8ff81cd172a1c00c927fc494a245a1e6a84c3d892f9de8926a46af637636: Status 404 returned error can't find the container with id 6c4a8ff81cd172a1c00c927fc494a245a1e6a84c3d892f9de8926a46af637636
Jul 21 02:14:06.091431 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:06.091405    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:06.091496 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:06.091464    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:06.091496 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:06.091492    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:06.813250 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:06.813213    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" event={"ID":"a531a675-a6d4-4eaa-85de-3bf2a8699dcb","Type":"ContainerStarted","Data":"538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651"}
Jul 21 02:14:06.813662 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:06.813295    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" event={"ID":"a531a675-a6d4-4eaa-85de-3bf2a8699dcb","Type":"ContainerStarted","Data":"6c4a8ff81cd172a1c00c927fc494a245a1e6a84c3d892f9de8926a46af637636"}
Jul 21 02:14:06.835605 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:06.835560    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podStartSLOduration=1.835545498 podStartE2EDuration="1.835545498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:14:06.833443239 +0000 UTC m=+2263.678436837" watchObservedRunningTime="2026-07-21 02:14:06.835545498 +0000 UTC m=+2263.680539092"
Jul 21 02:14:06.943534 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:06.943498    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:07.948856 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:07.948821    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:08.823090 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:08.823061    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:08.823988 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:08.823970    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:09.966534 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:09.966512    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:14:10.013527 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013454    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-envoy\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.013527 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013494    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-data\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.013527 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013514    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-podinfo\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.013807 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013545    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-socket\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.013807 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013613    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-credential-socket\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.013807 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013645    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cmqv\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-kube-api-access-6cmqv\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.013807 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013675    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-token\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.013807 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013701    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-certs\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.013807 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013727    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deca2893-0d31-40b1-82ce-b497ea8d646e-istiod-ca-cert\") pod \"deca2893-0d31-40b1-82ce-b497ea8d646e\" (UID: \"deca2893-0d31-40b1-82ce-b497ea8d646e\") "
Jul 21 02:14:10.014136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013932    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:14:10.014136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.013929    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:14:10.014136 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.014052    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.014298 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.014226    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-data" (OuterVolumeSpecName: "istio-data") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:14:10.014298 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.014261    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deca2893-0d31-40b1-82ce-b497ea8d646e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:14:10.014429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.014379    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:14:10.015862 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.015835    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:14:10.015962 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.015895    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-token" (OuterVolumeSpecName: "istio-token") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:14:10.015962 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.015904    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:14:10.016065 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.016044    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-kube-api-access-6cmqv" (OuterVolumeSpecName: "kube-api-access-6cmqv") pod "deca2893-0d31-40b1-82ce-b497ea8d646e" (UID: "deca2893-0d31-40b1-82ce-b497ea8d646e"). InnerVolumeSpecName "kube-api-access-6cmqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:14:10.119430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.115221    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.119430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.115270    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cmqv\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-kube-api-access-6cmqv\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.119430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.115286    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.119430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.115299    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.119430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.115330    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deca2893-0d31-40b1-82ce-b497ea8d646e-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.119430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.115348    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.119430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.115362    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.119430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.115374    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deca2893-0d31-40b1-82ce-b497ea8d646e-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:14:10.835193 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.835150    2568 generic.go:356] "Generic (PLEG): container finished" podID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerID="63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc" exitCode=0
Jul 21 02:14:10.835409 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.835212    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"
Jul 21 02:14:10.835409 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.835239    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" event={"ID":"deca2893-0d31-40b1-82ce-b497ea8d646e","Type":"ContainerDied","Data":"63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc"}
Jul 21 02:14:10.835409 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.835295    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5" event={"ID":"deca2893-0d31-40b1-82ce-b497ea8d646e","Type":"ContainerDied","Data":"b24e5e9594497b832fd723257d191cce497f17ea2e37aa94046dbd27a6326b1b"}
Jul 21 02:14:10.835409 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.835335    2568 scope.go:117] "RemoveContainer" containerID="63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc"
Jul 21 02:14:10.845240 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.845110    2568 scope.go:117] "RemoveContainer" containerID="a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae"
Jul 21 02:14:10.852836 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.852816    2568 scope.go:117] "RemoveContainer" containerID="63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc"
Jul 21 02:14:10.853084 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:14:10.853064    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc\": container with ID starting with 63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc not found: ID does not exist" containerID="63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc"
Jul 21 02:14:10.853148 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.853091    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc"} err="failed to get container status \"63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc\": rpc error: code = NotFound desc = could not find container \"63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc\": container with ID starting with 63fcf858643ec500d258393314f5c4f99fcf33b4955b7398c6aad661154905cc not found: ID does not exist"
Jul 21 02:14:10.853148 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.853107    2568 scope.go:117] "RemoveContainer" containerID="a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae"
Jul 21 02:14:10.853373 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:14:10.853355    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae\": container with ID starting with a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae not found: ID does not exist" containerID="a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae"
Jul 21 02:14:10.853420 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.853378    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae"} err="failed to get container status \"a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae\": rpc error: code = NotFound desc = could not find container \"a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae\": container with ID starting with a8fdebb7419ee77a84f73d845746877020587111c272b31073011308042421ae not found: ID does not exist"
Jul 21 02:14:10.862126 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.862105    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"]
Jul 21 02:14:10.866362 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:10.866341    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-27bb16-openshift-default-5fff6699cf-gsln5"]
Jul 21 02:14:11.726248 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:11.726217    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" path="/var/lib/kubelet/pods/deca2893-0d31-40b1-82ce-b497ea8d646e/volumes"
Jul 21 02:14:14.095277 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.095245    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"]
Jul 21 02:14:14.095749 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.095687    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy"
Jul 21 02:14:14.095749 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.095702    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy"
Jul 21 02:14:14.095749 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.095717    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy"
Jul 21 02:14:14.095749 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.095726    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy"
Jul 21 02:14:14.095887 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.095815    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy"
Jul 21 02:14:14.095887 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.095825    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="deca2893-0d31-40b1-82ce-b497ea8d646e" containerName="istio-proxy"
Jul 21 02:14:14.099208 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.099185    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.101692 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.101676    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-120127-openshift-default-dockercfg-zxmzt\""
Jul 21 02:14:14.110551 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.110532    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"]
Jul 21 02:14:14.139497 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139471    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fa41458-3881-4698-8dab-93de8a7fbb34-istiod-ca-cert\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.139642 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-socket\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.139642 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139557    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-certs\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.139642 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-credential-socket\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.139642 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139608    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-data\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.139642 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-podinfo\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.139827 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139657    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-token\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.139827 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-envoy\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.139827 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.139742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tf2\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-kube-api-access-f8tf2\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240230 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-envoy\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tf2\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-kube-api-access-f8tf2\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fa41458-3881-4698-8dab-93de8a7fbb34-istiod-ca-cert\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-socket\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240407    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-certs\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-credential-socket\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240458    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-data\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240824 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240483    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-podinfo\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240824 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240586    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-token\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240824 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240790    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-socket\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.240962 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-credential-socket\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.241001 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-data\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.241001 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.240992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-certs\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.241269 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.241249    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fa41458-3881-4698-8dab-93de8a7fbb34-istiod-ca-cert\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.242704 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.242677    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-envoy\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.243085 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.243064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-podinfo\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.247894 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.247868    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-token\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.248082 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.248068    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tf2\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-kube-api-access-f8tf2\") pod \"e2e-api-b-120127-openshift-default-d585567d7-bhs6m\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") " pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.409776 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.409741    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:14.544744 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.544711    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"]
Jul 21 02:14:14.548818 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:14:14.548784    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa41458_3881_4698_8dab_93de8a7fbb34.slice/crio-d45122a42802b692adc82a36cc85853fb09b75b9e70d78c46b99682963cd78a1 WatchSource:0}: Error finding container d45122a42802b692adc82a36cc85853fb09b75b9e70d78c46b99682963cd78a1: Status 404 returned error can't find the container with id d45122a42802b692adc82a36cc85853fb09b75b9e70d78c46b99682963cd78a1
Jul 21 02:14:14.550818 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.550785    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:14.550910 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.550848    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:14.550910 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.550872    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:14.858167 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.858074    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" event={"ID":"2fa41458-3881-4698-8dab-93de8a7fbb34","Type":"ContainerStarted","Data":"a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700"}
Jul 21 02:14:14.858167 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.858137    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" event={"ID":"2fa41458-3881-4698-8dab-93de8a7fbb34","Type":"ContainerStarted","Data":"d45122a42802b692adc82a36cc85853fb09b75b9e70d78c46b99682963cd78a1"}
Jul 21 02:14:14.879456 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:14.879405    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" podStartSLOduration=0.879389264 podStartE2EDuration="879.389264ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:14:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:14:14.877015902 +0000 UTC m=+2271.722009513" watchObservedRunningTime="2026-07-21 02:14:14.879389264 +0000 UTC m=+2271.724382857"
Jul 21 02:14:15.410180 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:15.410147    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:15.415514 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:15.415491    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:15.862701 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:15.862602    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:15.863404 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:15.863383    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:16.924012 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:16.923983    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"]
Jul 21 02:14:16.929253 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:16.929234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:16.931592 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:16.931572    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-120127-serving-cert\""
Jul 21 02:14:16.939126 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:16.939102    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"]
Jul 21 02:14:16.960716 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:16.960681    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-openshift-service-ca\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:16.960923 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:16.960777    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wgdn\" (UniqueName: \"kubernetes.io/projected/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-kube-api-access-7wgdn\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:16.960923 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:16.960845    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:17.061478 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:17.061427    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:17.061673 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:17.061584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-openshift-service-ca\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:17.061673 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:14:17.061603    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-120127-serving-cert: secret "maas-api-e2e-api-b-120127-serving-cert" not found
Jul 21 02:14:17.061673 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:17.061624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wgdn\" (UniqueName: \"kubernetes.io/projected/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-kube-api-access-7wgdn\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:17.061846 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:14:17.061691    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls podName:16ee7fed-3dd4-4c63-9b8a-ccd04a72633f nodeName:}" failed. No retries permitted until 2026-07-21 02:14:17.561667337 +0000 UTC m=+2274.406660910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls") pod "maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d" (UID: "16ee7fed-3dd4-4c63-9b8a-ccd04a72633f") : secret "maas-api-e2e-api-b-120127-serving-cert" not found
Jul 21 02:14:17.062456 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:17.062423    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-openshift-service-ca\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:17.073025 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:17.072990    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wgdn\" (UniqueName: \"kubernetes.io/projected/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-kube-api-access-7wgdn\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:17.567407 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:17.567367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:17.569799 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:17.569769    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls\") pod \"maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:17.842016 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:17.841932    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:18.011983 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:14:18.011903    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ee7fed_3dd4_4c63_9b8a_ccd04a72633f.slice/crio-7be529fd644b742fd42d5252fb1468633a7266dba30d70c22cfcf91dcfdcdf82 WatchSource:0}: Error finding container 7be529fd644b742fd42d5252fb1468633a7266dba30d70c22cfcf91dcfdcdf82: Status 404 returned error can't find the container with id 7be529fd644b742fd42d5252fb1468633a7266dba30d70c22cfcf91dcfdcdf82
Jul 21 02:14:18.013874 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:18.013846    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"]
Jul 21 02:14:18.879881 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:18.879852    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d" event={"ID":"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f","Type":"ContainerStarted","Data":"5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4"}
Jul 21 02:14:18.880060 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:18.879912    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:18.880060 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:18.879936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d" event={"ID":"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f","Type":"ContainerStarted","Data":"7be529fd644b742fd42d5252fb1468633a7266dba30d70c22cfcf91dcfdcdf82"}
Jul 21 02:14:18.896729 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:18.896665    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d" podStartSLOduration=2.527961451 podStartE2EDuration="2.896644548s" totalImagesPullingTime="368.683097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:14:18.894562231 +0000 UTC m=+2275.739555821" watchObservedRunningTime="2026-07-21 02:14:18.896644548 +0000 UTC m=+2275.741638144"
Jul 21 02:14:24.111037 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.111003    2568 patch_prober.go:28] interesting pod/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": read tcp 10.134.0.2:33978->10.134.0.43:15021: read: connection reset by peer" start-of-body=
Jul 21 02:14:24.111481 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.111066    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": read tcp 10.134.0.2:33978->10.134.0.43:15021: read: connection reset by peer"
Jul 21 02:14:24.890184 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.890154    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:14:24.916614 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.916587    2568 generic.go:356] "Generic (PLEG): container finished" podID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerID="538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651" exitCode=0
Jul 21 02:14:24.916770 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.916641    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" event={"ID":"a531a675-a6d4-4eaa-85de-3bf2a8699dcb","Type":"ContainerDied","Data":"538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651"}
Jul 21 02:14:24.917051 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.917031    2568 scope.go:117] "RemoveContainer" containerID="538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651"
Jul 21 02:14:24.918247 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.918214    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:24.918365 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.918296    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:24.918365 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:24.918360    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:25.923258 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:25.923216    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" event={"ID":"a531a675-a6d4-4eaa-85de-3bf2a8699dcb","Type":"ContainerStarted","Data":"a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a"}
Jul 21 02:14:25.943667 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:25.943636    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:25.943891 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:25.943872    2568 patch_prober.go:28] interesting pod/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 21 02:14:25.943976 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:25.943932    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 21 02:14:26.944098 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:26.944055    2568 patch_prober.go:28] interesting pod/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 21 02:14:26.944645 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:26.944113    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 21 02:14:27.943668 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:27.943632    2568 patch_prober.go:28] interesting pod/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 21 02:14:27.943857 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:27.943682    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 21 02:14:28.943902 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:28.943872    2568 patch_prober.go:28] interesting pod/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 21 02:14:28.944337 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:28.943921    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 21 02:14:29.943557 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:29.943460    2568 patch_prober.go:28] interesting pod/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 21 02:14:29.943557 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:29.943516    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 21 02:14:30.947262 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:30.947229    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:30.947736 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:30.947616    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:30.948469 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:30.948443    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:14:31.903453 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:31.903411    2568 patch_prober.go:28] interesting pod/e2e-api-b-120127-openshift-default-d585567d7-bhs6m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 02:14:31.903647 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:31.903470    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 02:14:32.964835 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:32.964806    2568 generic.go:356] "Generic (PLEG): container finished" podID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerID="a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700" exitCode=0
Jul 21 02:14:32.965260 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:32.964885    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" event={"ID":"2fa41458-3881-4698-8dab-93de8a7fbb34","Type":"ContainerDied","Data":"a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700"}
Jul 21 02:14:32.965378 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:32.965362    2568 scope.go:117] "RemoveContainer" containerID="a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700"
Jul 21 02:14:32.966295 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:32.966264    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:32.966413 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:32.966350    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:32.966413 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:32.966383    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:14:33.971908 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:33.971875    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" event={"ID":"2fa41458-3881-4698-8dab-93de8a7fbb34","Type":"ContainerStarted","Data":"82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429"}
Jul 21 02:14:34.410813 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:34.410771    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:34.411103 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:34.411077    2568 patch_prober.go:28] interesting pod/e2e-api-b-120127-openshift-default-d585567d7-bhs6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 21 02:14:34.411159 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:34.411136    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 21 02:14:35.410646 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:35.410602    2568 patch_prober.go:28] interesting pod/e2e-api-b-120127-openshift-default-d585567d7-bhs6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 21 02:14:35.411036 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:35.410669    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 21 02:14:36.410684 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:36.410640    2568 patch_prober.go:28] interesting pod/e2e-api-b-120127-openshift-default-d585567d7-bhs6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 21 02:14:36.411096 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:36.410711    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 21 02:14:37.411058 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:37.411014    2568 patch_prober.go:28] interesting pod/e2e-api-b-120127-openshift-default-d585567d7-bhs6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 21 02:14:37.411460 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:37.411085    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 21 02:14:38.414381 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:38.414348    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:38.414762 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:38.414616    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:38.415301 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:38.415283    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:14:56.390225 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:56.390193    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"]
Jul 21 02:14:56.390754 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:14:56.390423    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy" containerID="cri-o://a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a" gracePeriod=30
Jul 21 02:15:00.949553 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:00.949516    2568 patch_prober.go:28] interesting pod/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 02:15:00.949918 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:00.949573    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 02:15:01.631114 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.631090    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:15:01.758705 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758630    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-socket\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758705 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758661    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-envoy\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758705 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758700    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-certs\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758956 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758738    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-token\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758956 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758764    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c8nz\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-kube-api-access-5c8nz\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758956 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758809    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istiod-ca-cert\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758956 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758833    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-data\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758956 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758862    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-credential-socket\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758956 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758893    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-podinfo\") pod \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\" (UID: \"a531a675-a6d4-4eaa-85de-3bf2a8699dcb\") "
Jul 21 02:15:01.758956 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.758940    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:01.759369 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.759036    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:01.759369 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.759230    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:01.759369 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.759249    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:01.759369 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.759244    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:15:01.759369 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.759256    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:01.760095 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.760067    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-data" (OuterVolumeSpecName: "istio-data") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:01.760931 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.760906    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:01.761018 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.760911    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-token" (OuterVolumeSpecName: "istio-token") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:15:01.761018 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.760955    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-kube-api-access-5c8nz" (OuterVolumeSpecName: "kube-api-access-5c8nz") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "kube-api-access-5c8nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:15:01.761092 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.761077    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a531a675-a6d4-4eaa-85de-3bf2a8699dcb" (UID: "a531a675-a6d4-4eaa-85de-3bf2a8699dcb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:15:01.860653 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.860614    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:01.860653 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.860644    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:01.860653 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.860657    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c8nz\" (UniqueName: \"kubernetes.io/projected/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-kube-api-access-5c8nz\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:01.860937 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.860670    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:01.860937 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.860684    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:01.860937 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.860695    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:01.860937 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:01.860705    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a531a675-a6d4-4eaa-85de-3bf2a8699dcb-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:02.105645 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.105551    2568 generic.go:356] "Generic (PLEG): container finished" podID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerID="a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a" exitCode=0
Jul 21 02:15:02.105645 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.105613    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"
Jul 21 02:15:02.105645 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.105627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" event={"ID":"a531a675-a6d4-4eaa-85de-3bf2a8699dcb","Type":"ContainerDied","Data":"a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a"}
Jul 21 02:15:02.106158 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.105684    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75" event={"ID":"a531a675-a6d4-4eaa-85de-3bf2a8699dcb","Type":"ContainerDied","Data":"6c4a8ff81cd172a1c00c927fc494a245a1e6a84c3d892f9de8926a46af637636"}
Jul 21 02:15:02.106158 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.105709    2568 scope.go:117] "RemoveContainer" containerID="a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a"
Jul 21 02:15:02.115138 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.115121    2568 scope.go:117] "RemoveContainer" containerID="538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651"
Jul 21 02:15:02.123174 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.123160    2568 scope.go:117] "RemoveContainer" containerID="a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a"
Jul 21 02:15:02.123419 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:15:02.123401    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a\": container with ID starting with a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a not found: ID does not exist" containerID="a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a"
Jul 21 02:15:02.123470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.123427    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a"} err="failed to get container status \"a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a\": rpc error: code = NotFound desc = could not find container \"a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a\": container with ID starting with a4ca59133236f9df1fcf724b4214012c7373b024dedb152db45f6cc144c11f2a not found: ID does not exist"
Jul 21 02:15:02.123470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.123445    2568 scope.go:117] "RemoveContainer" containerID="538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651"
Jul 21 02:15:02.123655 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:15:02.123637    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651\": container with ID starting with 538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651 not found: ID does not exist" containerID="538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651"
Jul 21 02:15:02.123701 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.123661    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651"} err="failed to get container status \"538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651\": rpc error: code = NotFound desc = could not find container \"538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651\": container with ID starting with 538b4222292cea5483cd99f11fa16209e8bbcef73334772cfe9a23e29f8fc651 not found: ID does not exist"
Jul 21 02:15:02.128707 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.128689    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"]
Jul 21 02:15:02.132418 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:02.132400    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-91b59b-openshift-default-6f5bfd468c-pzx75"]
Jul 21 02:15:03.726393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:03.726364    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" path="/var/lib/kubelet/pods/a531a675-a6d4-4eaa-85de-3bf2a8699dcb/volumes"
Jul 21 02:15:12.251222 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.251189    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"]
Jul 21 02:15:12.251802 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.251429    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d" podUID="16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" containerName="maas-api" containerID="cri-o://5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4" gracePeriod=30
Jul 21 02:15:12.488409 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.488388    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:15:12.550461 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.550395    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls\") pod \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") "
Jul 21 02:15:12.550461 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.550456    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wgdn\" (UniqueName: \"kubernetes.io/projected/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-kube-api-access-7wgdn\") pod \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") "
Jul 21 02:15:12.550627 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.550481    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-openshift-service-ca\") pod \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\" (UID: \"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f\") "
Jul 21 02:15:12.550886 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.550858    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" (UID: "16ee7fed-3dd4-4c63-9b8a-ccd04a72633f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:15:12.552409 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.552377    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" (UID: "16ee7fed-3dd4-4c63-9b8a-ccd04a72633f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:15:12.552490 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.552426    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-kube-api-access-7wgdn" (OuterVolumeSpecName: "kube-api-access-7wgdn") pod "16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" (UID: "16ee7fed-3dd4-4c63-9b8a-ccd04a72633f"). InnerVolumeSpecName "kube-api-access-7wgdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:15:12.651706 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.651682    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-maas-api-tls\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:12.651706 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.651706    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wgdn\" (UniqueName: \"kubernetes.io/projected/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-kube-api-access-7wgdn\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:12.651706 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:12.651715    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f-openshift-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:13.159921 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.159883    2568 generic.go:356] "Generic (PLEG): container finished" podID="16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" containerID="5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4" exitCode=0
Jul 21 02:15:13.160096 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.159930    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"
Jul 21 02:15:13.160096 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.159933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d" event={"ID":"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f","Type":"ContainerDied","Data":"5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4"}
Jul 21 02:15:13.160096 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.159986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d" event={"ID":"16ee7fed-3dd4-4c63-9b8a-ccd04a72633f","Type":"ContainerDied","Data":"7be529fd644b742fd42d5252fb1468633a7266dba30d70c22cfcf91dcfdcdf82"}
Jul 21 02:15:13.160096 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.160017    2568 scope.go:117] "RemoveContainer" containerID="5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4"
Jul 21 02:15:13.171603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.171583    2568 scope.go:117] "RemoveContainer" containerID="5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4"
Jul 21 02:15:13.171855 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:15:13.171836    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4\": container with ID starting with 5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4 not found: ID does not exist" containerID="5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4"
Jul 21 02:15:13.171909 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.171865    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4"} err="failed to get container status \"5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4\": rpc error: code = NotFound desc = could not find container \"5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4\": container with ID starting with 5226575bb462dd5e3d58db8e114dcbe03a1c3d7261d5b1a9fa3a54677bb454c4 not found: ID does not exist"
Jul 21 02:15:13.183470 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.183449    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"]
Jul 21 02:15:13.187342 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.187302    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-120127-6c6c8454c7-5bl2d"]
Jul 21 02:15:13.727134 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:13.727100    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" path="/var/lib/kubelet/pods/16ee7fed-3dd4-4c63-9b8a-ccd04a72633f/volumes"
Jul 21 02:15:23.380147 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:23.380108    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"]
Jul 21 02:15:23.380756 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:23.380369    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy" containerID="cri-o://82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429" gracePeriod=30
Jul 21 02:15:23.416811 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:23.416783    2568 patch_prober.go:28] interesting pod/e2e-api-b-120127-openshift-default-d585567d7-bhs6m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 02:15:23.416938 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:23.416831    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 02:15:24.307863 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.307829    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"]
Jul 21 02:15:24.308154 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.308140    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" containerName="maas-api"
Jul 21 02:15:24.308208 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.308159    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" containerName="maas-api"
Jul 21 02:15:24.308208 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.308174    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy"
Jul 21 02:15:24.308208 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.308179    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy"
Jul 21 02:15:24.308208 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.308188    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy"
Jul 21 02:15:24.308208 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.308193    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy"
Jul 21 02:15:24.308391 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.308249    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy"
Jul 21 02:15:24.308391 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.308260    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ee7fed-3dd4-4c63-9b8a-ccd04a72633f" containerName="maas-api"
Jul 21 02:15:24.311587 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.311568    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.314380 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.314363    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-748a4d-openshift-default-dockercfg-fblbj\""
Jul 21 02:15:24.329387 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.329368    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"]
Jul 21 02:15:24.449860 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.449832    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-socket\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.450232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.449864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-data\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.450232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.449882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89qpb\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-kube-api-access-89qpb\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.450232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.449978    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-envoy\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.450232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.450006    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-certs\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.450232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.450047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-token\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.450232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.450080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-podinfo\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.450232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.450114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cd274af-0a25-4e4d-90af-8665f6e710b0-istiod-ca-cert\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.450232 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.450170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-credential-socket\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551061 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-envoy\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551205 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551066    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-certs\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551205 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-token\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551205 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-podinfo\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551205 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551167    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cd274af-0a25-4e4d-90af-8665f6e710b0-istiod-ca-cert\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551206    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-credential-socket\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551243    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-socket\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551265    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-data\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551286    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89qpb\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-kube-api-access-89qpb\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551657 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-certs\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551657 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551630    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-socket\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551903 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551881    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cd274af-0a25-4e4d-90af-8665f6e710b0-istiod-ca-cert\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.551989 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551928    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-data\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.552034 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.551982    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-credential-socket\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.553385 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.553367    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-envoy\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.553606 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.553589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-podinfo\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.558988 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.558926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-token\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.558988 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.558928    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89qpb\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-kube-api-access-89qpb\") pod \"e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") " pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.621626 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.621601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:24.760094 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.760070    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"]
Jul 21 02:15:24.761599 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:15:24.761568    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd274af_0a25_4e4d_90af_8665f6e710b0.slice/crio-029f33e1e8f6dd47005d8c00b8111570b88e2ce18d1907e3f154ef5e3cd1e42e WatchSource:0}: Error finding container 029f33e1e8f6dd47005d8c00b8111570b88e2ce18d1907e3f154ef5e3cd1e42e: Status 404 returned error can't find the container with id 029f33e1e8f6dd47005d8c00b8111570b88e2ce18d1907e3f154ef5e3cd1e42e
Jul 21 02:15:24.763797 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.763764    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:24.763910 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.763845    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:24.763910 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:24.763878    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:25.220641 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:25.220604    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" event={"ID":"1cd274af-0a25-4e4d-90af-8665f6e710b0","Type":"ContainerStarted","Data":"270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805"}
Jul 21 02:15:25.220834 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:25.220656    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" event={"ID":"1cd274af-0a25-4e4d-90af-8665f6e710b0","Type":"ContainerStarted","Data":"029f33e1e8f6dd47005d8c00b8111570b88e2ce18d1907e3f154ef5e3cd1e42e"}
Jul 21 02:15:25.244080 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:25.244024    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" podStartSLOduration=1.244006844 podStartE2EDuration="1.244006844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:15:25.243569193 +0000 UTC m=+2342.088562805" watchObservedRunningTime="2026-07-21 02:15:25.244006844 +0000 UTC m=+2342.089000439"
Jul 21 02:15:25.622618 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:25.622590    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:25.627164 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:25.627141    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:26.225474 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:26.225443    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:26.226423 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:26.226399    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:27.294201 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.294172    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"]
Jul 21 02:15:27.294584 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.294539    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a531a675-a6d4-4eaa-85de-3bf2a8699dcb" containerName="istio-proxy"
Jul 21 02:15:27.296616 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.296599    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.300027 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.300006    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-748a4d-serving-cert\""
Jul 21 02:15:27.309552 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.309532    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"]
Jul 21 02:15:27.375922 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.375888    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.376113 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.376058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dft6r\" (UniqueName: \"kubernetes.io/projected/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-kube-api-access-dft6r\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.376202 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.376143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.477145 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.477108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.477382 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.477177    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dft6r\" (UniqueName: \"kubernetes.io/projected/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-kube-api-access-dft6r\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.477382 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.477226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.477382 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:15:27.477278    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-serving-cert: secret "maas-api-e2e-shared-a-748a4d-serving-cert" not found
Jul 21 02:15:27.477382 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:15:27.477377    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls podName:5b533633-6de5-4f3d-85b5-0c4a5ef61bf6 nodeName:}" failed. No retries permitted until 2026-07-21 02:15:27.977355907 +0000 UTC m=+2344.822349485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls") pod "maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk" (UID: "5b533633-6de5-4f3d-85b5-0c4a5ef61bf6") : secret "maas-api-e2e-shared-a-748a4d-serving-cert" not found
Jul 21 02:15:27.477838 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.477821    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.486346 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.486323    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dft6r\" (UniqueName: \"kubernetes.io/projected/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-kube-api-access-dft6r\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.981751 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.981712    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:27.984186 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:27.984158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls\") pod \"maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:28.206848 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.206814    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:28.334466 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.334441    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"]
Jul 21 02:15:28.335938 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:15:28.335909    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b533633_6de5_4f3d_85b5_0c4a5ef61bf6.slice/crio-30ed7ae6d90b1d9827554219db1e56cd222157480d3201f34b4c3e27f5c6e3f8 WatchSource:0}: Error finding container 30ed7ae6d90b1d9827554219db1e56cd222157480d3201f34b4c3e27f5c6e3f8: Status 404 returned error can't find the container with id 30ed7ae6d90b1d9827554219db1e56cd222157480d3201f34b4c3e27f5c6e3f8
Jul 21 02:15:28.630543 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.630522    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:15:28.687785 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.687757    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-podinfo\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.687923 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.687821    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-socket\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.687923 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.687849    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-token\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.687923 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.687884    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-data\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.688057 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.687923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-certs\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.688057 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.687953    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-credential-socket\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.688057 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.687978    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fa41458-3881-4698-8dab-93de8a7fbb34-istiod-ca-cert\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.688057 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.688003    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-envoy\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.688057 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.688034    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8tf2\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-kube-api-access-f8tf2\") pod \"2fa41458-3881-4698-8dab-93de8a7fbb34\" (UID: \"2fa41458-3881-4698-8dab-93de8a7fbb34\") "
Jul 21 02:15:28.688364 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.688167    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:28.688364 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.688261    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:28.688364 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.688280    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:28.688364 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.688338    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:28.688636 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.688610    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa41458-3881-4698-8dab-93de8a7fbb34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:15:28.689082 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.689060    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-data" (OuterVolumeSpecName: "istio-data") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:28.690057 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.690028    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-token" (OuterVolumeSpecName: "istio-token") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:15:28.690284 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.690264    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:15:28.690382 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.690360    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:15:28.690432 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.690387    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-kube-api-access-f8tf2" (OuterVolumeSpecName: "kube-api-access-f8tf2") pod "2fa41458-3881-4698-8dab-93de8a7fbb34" (UID: "2fa41458-3881-4698-8dab-93de8a7fbb34"). InnerVolumeSpecName "kube-api-access-f8tf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:15:28.789350 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.789328    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:28.789427 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.789353    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:28.789427 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.789362    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:28.789427 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.789370    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:28.789427 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.789378    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:28.789427 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.789387    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fa41458-3881-4698-8dab-93de8a7fbb34-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:28.789427 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.789396    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fa41458-3881-4698-8dab-93de8a7fbb34-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:28.789427 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:28.789403    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8tf2\" (UniqueName: \"kubernetes.io/projected/2fa41458-3881-4698-8dab-93de8a7fbb34-kube-api-access-f8tf2\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:15:29.239696 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.239657    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk" event={"ID":"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6","Type":"ContainerStarted","Data":"8b2589d4301ed3e56b4e8c601a758afe0a6dbbc29619b3e400dd1606f3fffab7"}
Jul 21 02:15:29.239909 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.239752    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:29.239909 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.239776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk" event={"ID":"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6","Type":"ContainerStarted","Data":"30ed7ae6d90b1d9827554219db1e56cd222157480d3201f34b4c3e27f5c6e3f8"}
Jul 21 02:15:29.241325 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.241287    2568 generic.go:356] "Generic (PLEG): container finished" podID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerID="82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429" exitCode=0
Jul 21 02:15:29.241431 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.241348    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" event={"ID":"2fa41458-3881-4698-8dab-93de8a7fbb34","Type":"ContainerDied","Data":"82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429"}
Jul 21 02:15:29.241431 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.241362    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"
Jul 21 02:15:29.241431 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.241384    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m" event={"ID":"2fa41458-3881-4698-8dab-93de8a7fbb34","Type":"ContainerDied","Data":"d45122a42802b692adc82a36cc85853fb09b75b9e70d78c46b99682963cd78a1"}
Jul 21 02:15:29.241431 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.241407    2568 scope.go:117] "RemoveContainer" containerID="82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429"
Jul 21 02:15:29.249815 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.249798    2568 scope.go:117] "RemoveContainer" containerID="a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700"
Jul 21 02:15:29.257185 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.257166    2568 scope.go:117] "RemoveContainer" containerID="82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429"
Jul 21 02:15:29.257446 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:15:29.257425    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429\": container with ID starting with 82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429 not found: ID does not exist" containerID="82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429"
Jul 21 02:15:29.257500 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.257453    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429"} err="failed to get container status \"82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429\": rpc error: code = NotFound desc = could not find container \"82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429\": container with ID starting with 82fcf6db20227638346fd6d85727adeb9d1804c75580a1c410ac77ed857c4429 not found: ID does not exist"
Jul 21 02:15:29.257500 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.257470    2568 scope.go:117] "RemoveContainer" containerID="a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700"
Jul 21 02:15:29.257707 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:15:29.257690    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700\": container with ID starting with a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700 not found: ID does not exist" containerID="a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700"
Jul 21 02:15:29.257754 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.257713    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700"} err="failed to get container status \"a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700\": rpc error: code = NotFound desc = could not find container \"a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700\": container with ID starting with a6f1f21bb1b12937dfb5108219e023de0765154336219b8500e6d5e7649f3700 not found: ID does not exist"
Jul 21 02:15:29.267207 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.267166    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk" podStartSLOduration=1.828323887 podStartE2EDuration="2.267152763s" totalImagesPullingTime="438.828876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:15:29.266058843 +0000 UTC m=+2346.111052435" watchObservedRunningTime="2026-07-21 02:15:29.267152763 +0000 UTC m=+2346.112146358"
Jul 21 02:15:29.298484 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.298463    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"]
Jul 21 02:15:29.313463 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.313442    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-120127-openshift-default-d585567d7-bhs6m"]
Jul 21 02:15:29.726258 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:29.726228    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" path="/var/lib/kubelet/pods/2fa41458-3881-4698-8dab-93de8a7fbb34/volumes"
Jul 21 02:15:32.343403 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.343371    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"]
Jul 21 02:15:32.343870 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.343820    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy"
Jul 21 02:15:32.343870 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.343838    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy"
Jul 21 02:15:32.343870 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.343860    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy"
Jul 21 02:15:32.343870 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.343868    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy"
Jul 21 02:15:32.344081 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.343959    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy"
Jul 21 02:15:32.344081 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.343970    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa41458-3881-4698-8dab-93de8a7fbb34" containerName="istio-proxy"
Jul 21 02:15:32.347099 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.347074    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.349216 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.349197    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c6538a-openshift-default-dockercfg-gcvgn\""
Jul 21 02:15:32.359362 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.359339    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"]
Jul 21 02:15:32.421386 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421338    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8gmr\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-kube-api-access-h8gmr\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.421572 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93b26af1-1424-4457-90f3-0ade62562127-istio-podinfo\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.421572 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-certs\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.421572 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-istio-token\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.421572 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-socket\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.421572 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-envoy\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.421799 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421586    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93b26af1-1424-4457-90f3-0ade62562127-istiod-ca-cert\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.421799 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421629    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-data\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.421799 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.421700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-credential-socket\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.522844 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.522803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-istio-token\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523053 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.522859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-socket\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523053 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.522977    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-envoy\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523053 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93b26af1-1424-4457-90f3-0ade62562127-istiod-ca-cert\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523238 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-data\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523238 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-credential-socket\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523238 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523172    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8gmr\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-kube-api-access-h8gmr\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523238 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523231    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93b26af1-1424-4457-90f3-0ade62562127-istio-podinfo\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523479 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523264    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-certs\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523479 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-socket\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523577 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523491    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-credential-socket\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523577 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-data\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523795 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523770    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-certs\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.523917 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.523795    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93b26af1-1424-4457-90f3-0ade62562127-istiod-ca-cert\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.525335 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.525294    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-envoy\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.525693 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.525677    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93b26af1-1424-4457-90f3-0ade62562127-istio-podinfo\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.530173 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.530148    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-istio-token\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.530173 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.530170    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8gmr\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-kube-api-access-h8gmr\") pod \"e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") " pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.657565 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.657530    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:32.790103 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.790072    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"]
Jul 21 02:15:32.792634 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:15:32.792592    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b26af1_1424_4457_90f3_0ade62562127.slice/crio-c30a2d96d0b2b4cc63d84e058edefd9dd1664408e3a0d02955301f11f6cf4745 WatchSource:0}: Error finding container c30a2d96d0b2b4cc63d84e058edefd9dd1664408e3a0d02955301f11f6cf4745: Status 404 returned error can't find the container with id c30a2d96d0b2b4cc63d84e058edefd9dd1664408e3a0d02955301f11f6cf4745
Jul 21 02:15:32.794798 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.794769    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:32.794876 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.794836    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:32.794916 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:32.794883    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:33.263912 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:33.263875    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" event={"ID":"93b26af1-1424-4457-90f3-0ade62562127","Type":"ContainerStarted","Data":"3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd"}
Jul 21 02:15:33.264089 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:33.263957    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" event={"ID":"93b26af1-1424-4457-90f3-0ade62562127","Type":"ContainerStarted","Data":"c30a2d96d0b2b4cc63d84e058edefd9dd1664408e3a0d02955301f11f6cf4745"}
Jul 21 02:15:33.286954 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:33.286900    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" podStartSLOduration=1.286882313 podStartE2EDuration="1.286882313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:15:33.285265797 +0000 UTC m=+2350.130259392" watchObservedRunningTime="2026-07-21 02:15:33.286882313 +0000 UTC m=+2350.131875909"
Jul 21 02:15:33.658530 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:33.658487    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:33.663534 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:33.663507    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:34.268122 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:34.268082    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:34.269155 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:34.269136    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:35.254110 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:35.254083    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:15:42.266507 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:42.266464    2568 patch_prober.go:28] interesting pod/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 02:15:42.266891 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:42.266536    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 02:15:43.319139 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:43.319106    2568 generic.go:356] "Generic (PLEG): container finished" podID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerID="270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805" exitCode=0
Jul 21 02:15:43.319706 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:43.319190    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" event={"ID":"1cd274af-0a25-4e4d-90af-8665f6e710b0","Type":"ContainerDied","Data":"270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805"}
Jul 21 02:15:43.319782 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:43.319716    2568 scope.go:117] "RemoveContainer" containerID="270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805"
Jul 21 02:15:43.320751 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:43.320724    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:43.320809 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:43.320792    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:43.320848 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:43.320827    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:44.329430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:44.329385    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" event={"ID":"1cd274af-0a25-4e4d-90af-8665f6e710b0","Type":"ContainerStarted","Data":"e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a"}
Jul 21 02:15:44.622355 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:44.622299    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:44.622758 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:44.622659    2568 patch_prober.go:28] interesting pod/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 21 02:15:44.622922 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:44.622900    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 21 02:15:45.622226 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:45.622179    2568 patch_prober.go:28] interesting pod/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 21 02:15:45.622849 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:45.622801    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 21 02:15:46.623020 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:46.622979    2568 patch_prober.go:28] interesting pod/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 21 02:15:46.623617 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:46.623586    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 21 02:15:47.622672 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:47.622629    2568 patch_prober.go:28] interesting pod/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 21 02:15:47.622860 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:47.622693    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 21 02:15:48.625995 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:48.625966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:48.626460 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:48.626271    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:48.627140 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:48.627120    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:15:50.012630 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:50.012603    2568 patch_prober.go:28] interesting pod/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": read tcp 10.134.0.2:57932->10.134.0.48:15021: read: connection reset by peer" start-of-body=
Jul 21 02:15:50.012991 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:50.012669    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": read tcp 10.134.0.2:57932->10.134.0.48:15021: read: connection reset by peer"
Jul 21 02:15:50.361641 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:50.361546    2568 generic.go:356] "Generic (PLEG): container finished" podID="93b26af1-1424-4457-90f3-0ade62562127" containerID="3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd" exitCode=0
Jul 21 02:15:50.361641 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:50.361622    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" event={"ID":"93b26af1-1424-4457-90f3-0ade62562127","Type":"ContainerDied","Data":"3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd"}
Jul 21 02:15:50.362095 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:50.362081    2568 scope.go:117] "RemoveContainer" containerID="3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd"
Jul 21 02:15:50.363049 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:50.363025    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:50.363102 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:50.363089    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:50.363139 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:50.363120    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 21 02:15:51.368193 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:51.368160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" event={"ID":"93b26af1-1424-4457-90f3-0ade62562127","Type":"ContainerStarted","Data":"a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34"}
Jul 21 02:15:51.657787 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:51.657697    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:51.657963 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:51.657942    2568 patch_prober.go:28] interesting pod/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 21 02:15:51.658042 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:51.657998    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 21 02:15:52.658483 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:52.658449    2568 patch_prober.go:28] interesting pod/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 21 02:15:52.658887 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:52.658515    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 21 02:15:53.658620 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:53.658583    2568 patch_prober.go:28] interesting pod/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 21 02:15:53.659017 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:53.658650    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 21 02:15:54.658441 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:54.658403    2568 patch_prober.go:28] interesting pod/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 21 02:15:54.658625 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:54.658459    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 21 02:15:55.661733 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:55.661705    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:55.662130 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:55.661962    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:15:55.662507 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:15:55.662488    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:21:55.996185 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:55.996150    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"]
Jul 21 02:21:55.996703 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:55.996399    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk" podUID="5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" containerName="maas-api" containerID="cri-o://8b2589d4301ed3e56b4e8c601a758afe0a6dbbc29619b3e400dd1606f3fffab7" gracePeriod=30
Jul 21 02:21:56.119816 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.119787    2568 generic.go:356] "Generic (PLEG): container finished" podID="5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" containerID="8b2589d4301ed3e56b4e8c601a758afe0a6dbbc29619b3e400dd1606f3fffab7" exitCode=0
Jul 21 02:21:56.119942 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.119819    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk" event={"ID":"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6","Type":"ContainerDied","Data":"8b2589d4301ed3e56b4e8c601a758afe0a6dbbc29619b3e400dd1606f3fffab7"}
Jul 21 02:21:56.248966 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.248911    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:21:56.383784 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.383752    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls\") pod \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") "
Jul 21 02:21:56.383967 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.383793    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dft6r\" (UniqueName: \"kubernetes.io/projected/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-kube-api-access-dft6r\") pod \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") "
Jul 21 02:21:56.383967 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.383869    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-openshift-service-ca\") pod \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\" (UID: \"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6\") "
Jul 21 02:21:56.384282 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.384255    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" (UID: "5b533633-6de5-4f3d-85b5-0c4a5ef61bf6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:21:56.385805 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.385777    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" (UID: "5b533633-6de5-4f3d-85b5-0c4a5ef61bf6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 02:21:56.385917 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.385896    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-kube-api-access-dft6r" (OuterVolumeSpecName: "kube-api-access-dft6r") pod "5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" (UID: "5b533633-6de5-4f3d-85b5-0c4a5ef61bf6"). InnerVolumeSpecName "kube-api-access-dft6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:21:56.485429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.485392    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-openshift-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:21:56.485429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.485423    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-maas-api-tls\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:21:56.485429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:56.485433    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dft6r\" (UniqueName: \"kubernetes.io/projected/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6-kube-api-access-dft6r\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:21:57.125706 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:57.125675    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"
Jul 21 02:21:57.126094 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:57.125711    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk" event={"ID":"5b533633-6de5-4f3d-85b5-0c4a5ef61bf6","Type":"ContainerDied","Data":"30ed7ae6d90b1d9827554219db1e56cd222157480d3201f34b4c3e27f5c6e3f8"}
Jul 21 02:21:57.126094 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:57.125778    2568 scope.go:117] "RemoveContainer" containerID="8b2589d4301ed3e56b4e8c601a758afe0a6dbbc29619b3e400dd1606f3fffab7"
Jul 21 02:21:57.147953 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:57.147931    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"]
Jul 21 02:21:57.151890 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:57.151868    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-748a4d-79bc799c78-mgkqk"]
Jul 21 02:21:57.726342 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:21:57.726293    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" path="/var/lib/kubelet/pods/5b533633-6de5-4f3d-85b5-0c4a5ef61bf6/volumes"
Jul 21 02:22:07.464595 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:07.464551    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"]
Jul 21 02:22:07.465088 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:07.464806    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy" containerID="cri-o://e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a" gracePeriod=30
Jul 21 02:22:12.708835 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.708811    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:22:12.828455 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828375    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-data\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828455 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828422    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-socket\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828455 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828447    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-envoy\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828732 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828478    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-token\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828732 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828507    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cd274af-0a25-4e4d-90af-8665f6e710b0-istiod-ca-cert\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828732 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828542    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-credential-socket\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828732 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828574    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89qpb\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-kube-api-access-89qpb\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828732 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828607    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-certs\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828732 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828635    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-podinfo\") pod \"1cd274af-0a25-4e4d-90af-8665f6e710b0\" (UID: \"1cd274af-0a25-4e4d-90af-8665f6e710b0\") "
Jul 21 02:22:12.828732 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828686    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:12.829103 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828908    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:12.829103 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828993    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:12.829103 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.828989    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cd274af-0a25-4e4d-90af-8665f6e710b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:22:12.829263 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.829217    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:12.829349 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.829277    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:12.830735 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.830715    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:22:12.830860 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.830818    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:12.831099 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.831075    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:22:12.831099 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.831085    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-kube-api-access-89qpb" (OuterVolumeSpecName: "kube-api-access-89qpb") pod "1cd274af-0a25-4e4d-90af-8665f6e710b0" (UID: "1cd274af-0a25-4e4d-90af-8665f6e710b0"). InnerVolumeSpecName "kube-api-access-89qpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:22:12.929725 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.929678    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cd274af-0a25-4e4d-90af-8665f6e710b0-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:12.929725 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.929716    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:12.929725 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.929730    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89qpb\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-kube-api-access-89qpb\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:12.929983 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.929741    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:12.929983 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.929753    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:12.929983 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.929764    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:12.929983 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.929774    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:12.929983 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:12.929783    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cd274af-0a25-4e4d-90af-8665f6e710b0-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:13.203322 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.203285    2568 generic.go:356] "Generic (PLEG): container finished" podID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerID="e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a" exitCode=0
Jul 21 02:22:13.203522 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.203362    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"
Jul 21 02:22:13.203522 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.203376    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" event={"ID":"1cd274af-0a25-4e4d-90af-8665f6e710b0","Type":"ContainerDied","Data":"e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a"}
Jul 21 02:22:13.203522 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.203446    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb" event={"ID":"1cd274af-0a25-4e4d-90af-8665f6e710b0","Type":"ContainerDied","Data":"029f33e1e8f6dd47005d8c00b8111570b88e2ce18d1907e3f154ef5e3cd1e42e"}
Jul 21 02:22:13.203522 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.203477    2568 scope.go:117] "RemoveContainer" containerID="e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a"
Jul 21 02:22:13.212387 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.212372    2568 scope.go:117] "RemoveContainer" containerID="270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805"
Jul 21 02:22:13.220048 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.220031    2568 scope.go:117] "RemoveContainer" containerID="e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a"
Jul 21 02:22:13.220280 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:22:13.220260    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a\": container with ID starting with e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a not found: ID does not exist" containerID="e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a"
Jul 21 02:22:13.220366 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.220288    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a"} err="failed to get container status \"e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a\": rpc error: code = NotFound desc = could not find container \"e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a\": container with ID starting with e94229f8bcf7a578dd328e80a24ab66cc44286284ad76d0c14348b1989dab88a not found: ID does not exist"
Jul 21 02:22:13.220366 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.220320    2568 scope.go:117] "RemoveContainer" containerID="270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805"
Jul 21 02:22:13.220593 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:22:13.220576    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805\": container with ID starting with 270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805 not found: ID does not exist" containerID="270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805"
Jul 21 02:22:13.220639 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.220601    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805"} err="failed to get container status \"270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805\": rpc error: code = NotFound desc = could not find container \"270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805\": container with ID starting with 270364241c87590a9a2163919998d69bcdfd2925ababeee6fe3556527469f805 not found: ID does not exist"
Jul 21 02:22:13.225029 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.225009    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"]
Jul 21 02:22:13.228944 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.228925    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-748a4d-openshift-default-684677b69f-hgmwb"]
Jul 21 02:22:13.731940 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:13.731906    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" path="/var/lib/kubelet/pods/1cd274af-0a25-4e4d-90af-8665f6e710b0/volumes"
Jul 21 02:22:29.566382 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:29.566349    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"]
Jul 21 02:22:29.566832 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:29.566573    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy" containerID="cri-o://a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34" gracePeriod=30
Jul 21 02:22:34.812221 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.812195    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:22:34.895167 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895128    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-certs\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895182    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93b26af1-1424-4457-90f3-0ade62562127-istiod-ca-cert\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895210    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-socket\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895244    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8gmr\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-kube-api-access-h8gmr\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895269    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-data\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895334    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-credential-socket\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895362    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-istio-token\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895393 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895389    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93b26af1-1424-4457-90f3-0ade62562127-istio-podinfo\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895766 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895442    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-envoy\") pod \"93b26af1-1424-4457-90f3-0ade62562127\" (UID: \"93b26af1-1424-4457-90f3-0ade62562127\") "
Jul 21 02:22:34.895766 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895478    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:34.895766 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895570    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:34.895766 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895718    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93b26af1-1424-4457-90f3-0ade62562127-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 02:22:34.895766 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895741    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:34.895766 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.895761    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-workload-certs\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:34.896271 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.896228    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:34.896455 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.896426    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-data" (OuterVolumeSpecName: "istio-data") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:34.897603 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.897574    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-kube-api-access-h8gmr" (OuterVolumeSpecName: "kube-api-access-h8gmr") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "kube-api-access-h8gmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:22:34.897669 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.897641    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-istio-token" (OuterVolumeSpecName: "istio-token") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 02:22:34.897920 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.897894    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93b26af1-1424-4457-90f3-0ade62562127-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 02:22:34.897920 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.897896    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93b26af1-1424-4457-90f3-0ade62562127" (UID: "93b26af1-1424-4457-90f3-0ade62562127"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 02:22:34.997076 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.997038    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-envoy\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:34.997076 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.997073    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93b26af1-1424-4457-90f3-0ade62562127-istiod-ca-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:34.997076 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.997082    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8gmr\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-kube-api-access-h8gmr\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:34.997076 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.997091    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-istio-data\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:34.997337 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.997100    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93b26af1-1424-4457-90f3-0ade62562127-credential-socket\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:34.997337 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.997108    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93b26af1-1424-4457-90f3-0ade62562127-istio-token\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:34.997337 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:34.997117    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93b26af1-1424-4457-90f3-0ade62562127-istio-podinfo\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\""
Jul 21 02:22:35.310509 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.310422    2568 generic.go:356] "Generic (PLEG): container finished" podID="93b26af1-1424-4457-90f3-0ade62562127" containerID="a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34" exitCode=0
Jul 21 02:22:35.310509 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.310466    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"
Jul 21 02:22:35.310686 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.310516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" event={"ID":"93b26af1-1424-4457-90f3-0ade62562127","Type":"ContainerDied","Data":"a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34"}
Jul 21 02:22:35.310686 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.310568    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n" event={"ID":"93b26af1-1424-4457-90f3-0ade62562127","Type":"ContainerDied","Data":"c30a2d96d0b2b4cc63d84e058edefd9dd1664408e3a0d02955301f11f6cf4745"}
Jul 21 02:22:35.310686 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.310590    2568 scope.go:117] "RemoveContainer" containerID="a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34"
Jul 21 02:22:35.319845 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.319828    2568 scope.go:117] "RemoveContainer" containerID="3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd"
Jul 21 02:22:35.327639 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.327620    2568 scope.go:117] "RemoveContainer" containerID="a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34"
Jul 21 02:22:35.327895 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:22:35.327875    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34\": container with ID starting with a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34 not found: ID does not exist" containerID="a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34"
Jul 21 02:22:35.327970 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.327908    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34"} err="failed to get container status \"a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34\": rpc error: code = NotFound desc = could not find container \"a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34\": container with ID starting with a26f1a1e7593c81806d90186a9fdc299b7df7a0e3e3fdb9789bf36fd122bba34 not found: ID does not exist"
Jul 21 02:22:35.327970 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.327935    2568 scope.go:117] "RemoveContainer" containerID="3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd"
Jul 21 02:22:35.328189 ip-10-0-138-80 kubenswrapper[2568]: E0721 02:22:35.328173    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd\": container with ID starting with 3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd not found: ID does not exist" containerID="3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd"
Jul 21 02:22:35.328229 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.328196    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd"} err="failed to get container status \"3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd\": rpc error: code = NotFound desc = could not find container \"3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd\": container with ID starting with 3a00c8e3fd5ac6b2529fdadbfc7f9e2ed832f7d7976a6193e7e7f1d9775dd4cd not found: ID does not exist"
Jul 21 02:22:35.332044 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.332020    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"]
Jul 21 02:22:35.337665 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.337645    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c6538a-openshift-default-75c844c8f9-gbq5n"]
Jul 21 02:22:35.726539 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:35.726501    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b26af1-1424-4457-90f3-0ade62562127" path="/var/lib/kubelet/pods/93b26af1-1424-4457-90f3-0ade62562127/volumes"
Jul 21 02:22:36.637883 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:36.637852    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm_06191940-2bce-416c-abe3-8a3eeb36a148/copy-manifests/0.log"
Jul 21 02:22:36.645242 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:36.645223    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm_06191940-2bce-416c-abe3-8a3eeb36a148/manager/0.log"
Jul 21 02:22:37.129990 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:37.129961    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-665dc6758-7g52b_883e2761-c098-4f6f-a532-c7992b4915da/maas-api/0.log"
Jul 21 02:22:37.265181 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:37.265157    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743320-l5thb_7cb5a829-4784-4d8f-bff0-c94e298c11a6/cleanup/0.log"
Jul 21 02:22:37.493432 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:37.493356    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-bnhns_2454bf10-fb56-40db-9809-ce5d22db92bb/postgres/0.log"
Jul 21 02:22:38.303618 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.303593    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd_7445dcf0-a628-4066-adae-6523eb0200c9/util/0.log"
Jul 21 02:22:38.310210 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.310186    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd_7445dcf0-a628-4066-adae-6523eb0200c9/pull/0.log"
Jul 21 02:22:38.316429 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.316410    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd_7445dcf0-a628-4066-adae-6523eb0200c9/extract/0.log"
Jul 21 02:22:38.429243 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.429209    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw_c87ca6cd-2c35-4086-ba41-bce02fa0e2a3/extract/0.log"
Jul 21 02:22:38.435371 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.435354    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw_c87ca6cd-2c35-4086-ba41-bce02fa0e2a3/util/0.log"
Jul 21 02:22:38.441809 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.441791    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw_c87ca6cd-2c35-4086-ba41-bce02fa0e2a3/pull/0.log"
Jul 21 02:22:38.553896 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.553823    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9_c07cf9ca-4da8-4bde-96d0-4c428d5da979/extract/0.log"
Jul 21 02:22:38.560587 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.560562    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9_c07cf9ca-4da8-4bde-96d0-4c428d5da979/util/0.log"
Jul 21 02:22:38.567730 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.567706    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9_c07cf9ca-4da8-4bde-96d0-4c428d5da979/pull/0.log"
Jul 21 02:22:38.688490 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.688462    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g_7fbc8207-f639-472c-85a5-d347f19eb66d/pull/0.log"
Jul 21 02:22:38.695321 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.695287    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g_7fbc8207-f639-472c-85a5-d347f19eb66d/extract/0.log"
Jul 21 02:22:38.701595 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:38.701575    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g_7fbc8207-f639-472c-85a5-d347f19eb66d/util/0.log"
Jul 21 02:22:40.103657 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:40.099715    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678tbmj7_aa2d4440-3482-47d3-9a6a-e48499a19c49/istio-proxy/0.log"
Jul 21 02:22:40.223653 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:40.223621    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lqltt_db456430-6275-4aad-b6a6-a56f3686230d/discovery/0.log"
Jul 21 02:22:41.629779 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:41.629755    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7cw28_68b81b2e-7c7d-4abd-b446-3c88e05bc84a/main/0.log"
Jul 21 02:22:41.874852 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:41.874819    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rc2gh_5cb375eb-1bbf-44c3-ba87-25638ee949cf/main/0.log"
Jul 21 02:22:51.088635 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:51.088604    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pz2tk_9fe3eb07-b8c1-4f5d-9773-b6633b6a9230/global-pull-secret-syncer/0.log"
Jul 21 02:22:51.189493 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:51.189467    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rm77x_9da9e6bc-7d4d-4697-becd-360d85131b1d/konnectivity-agent/0.log"
Jul 21 02:22:51.280172 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:51.280142    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-80.ec2.internal_136b9eb90b068a35c8b9176c00f34cf5/haproxy/0.log"
Jul 21 02:22:55.791158 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:55.791126    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd_7445dcf0-a628-4066-adae-6523eb0200c9/extract/0.log"
Jul 21 02:22:55.820938 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:55.820912    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd_7445dcf0-a628-4066-adae-6523eb0200c9/util/0.log"
Jul 21 02:22:55.848325 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:55.848286    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75968jqd_7445dcf0-a628-4066-adae-6523eb0200c9/pull/0.log"
Jul 21 02:22:55.879861 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:55.879837    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw_c87ca6cd-2c35-4086-ba41-bce02fa0e2a3/extract/0.log"
Jul 21 02:22:55.907790 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:55.907768    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw_c87ca6cd-2c35-4086-ba41-bce02fa0e2a3/util/0.log"
Jul 21 02:22:55.935083 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:55.935060    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07scjw_c87ca6cd-2c35-4086-ba41-bce02fa0e2a3/pull/0.log"
Jul 21 02:22:55.965216 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:55.965193    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9_c07cf9ca-4da8-4bde-96d0-4c428d5da979/extract/0.log"
Jul 21 02:22:55.993554 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:55.993531    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9_c07cf9ca-4da8-4bde-96d0-4c428d5da979/util/0.log"
Jul 21 02:22:56.030099 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:56.030076    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739d4h9_c07cf9ca-4da8-4bde-96d0-4c428d5da979/pull/0.log"
Jul 21 02:22:56.058365 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:56.058279    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g_7fbc8207-f639-472c-85a5-d347f19eb66d/extract/0.log"
Jul 21 02:22:56.081400 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:56.081375    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g_7fbc8207-f639-472c-85a5-d347f19eb66d/util/0.log"
Jul 21 02:22:56.104872 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:56.104851    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rhb9g_7fbc8207-f639-472c-85a5-d347f19eb66d/pull/0.log"
Jul 21 02:22:59.454643 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:59.454615    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-645zh_9e0bc03c-28bf-4499-9360-90e17e9f35b8/node-exporter/0.log"
Jul 21 02:22:59.480482 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:59.480450    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-645zh_9e0bc03c-28bf-4499-9360-90e17e9f35b8/kube-rbac-proxy/0.log"
Jul 21 02:22:59.530119 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:22:59.530088    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-645zh_9e0bc03c-28bf-4499-9360-90e17e9f35b8/init-textfile/0.log"
Jul 21 02:23:01.225481 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225444    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"]
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225735    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225745    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225757    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225762    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225774    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225780    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225786    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" containerName="maas-api"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225791    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" containerName="maas-api"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225836    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b26af1-1424-4457-90f3-0ade62562127" containerName="istio-proxy"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225842    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd274af-0a25-4e4d-90af-8665f6e710b0" containerName="istio-proxy"
Jul 21 02:23:01.225864 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.225847    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b533633-6de5-4f3d-85b5-0c4a5ef61bf6" containerName="maas-api"
Jul 21 02:23:01.228536 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.228514    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.231379 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.231357    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gfbpz\"/\"kube-root-ca.crt\""
Jul 21 02:23:01.231487 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.231393    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gfbpz\"/\"openshift-service-ca.crt\""
Jul 21 02:23:01.232316 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.232284    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gfbpz\"/\"default-dockercfg-blw8z\""
Jul 21 02:23:01.238083 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.238064    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"]
Jul 21 02:23:01.313113 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.313076    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-podres\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.313336 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.313122    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-sys\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.313336 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.313205    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqql9\" (UniqueName: \"kubernetes.io/projected/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-kube-api-access-rqql9\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.313336 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.313268    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-lib-modules\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.313336 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.313299    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-proc\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414430 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-podres\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414599 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414439    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-sys\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414599 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqql9\" (UniqueName: \"kubernetes.io/projected/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-kube-api-access-rqql9\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414599 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-lib-modules\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414599 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-proc\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414599 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414572    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-podres\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414850 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414582    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-proc\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414850 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-sys\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.414850 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.414648    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-lib-modules\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.423154 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.423128    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqql9\" (UniqueName: \"kubernetes.io/projected/fa6711aa-4e38-43e8-b9f3-f45d9db8c388-kube-api-access-rqql9\") pod \"perf-node-gather-daemonset-wsbcn\" (UID: \"fa6711aa-4e38-43e8-b9f3-f45d9db8c388\") " pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.539009 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.538917    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:01.668426 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:01.668395    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"]
Jul 21 02:23:01.672060 ip-10-0-138-80 kubenswrapper[2568]: W0721 02:23:01.672031    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa6711aa_4e38_43e8_b9f3_f45d9db8c388.slice/crio-63d446c0d1459ef39acc4bde16fc202c2dcfa62138553e3c20e62c77e033a6f4 WatchSource:0}: Error finding container 63d446c0d1459ef39acc4bde16fc202c2dcfa62138553e3c20e62c77e033a6f4: Status 404 returned error can't find the container with id 63d446c0d1459ef39acc4bde16fc202c2dcfa62138553e3c20e62c77e033a6f4
Jul 21 02:23:02.438896 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:02.438859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn" event={"ID":"fa6711aa-4e38-43e8-b9f3-f45d9db8c388","Type":"ContainerStarted","Data":"c3231f5c2c62cbd18ccdbe434cb6561dd70dcef52925adc1099b1474e02fbda4"}
Jul 21 02:23:02.439300 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:02.438914    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn" event={"ID":"fa6711aa-4e38-43e8-b9f3-f45d9db8c388","Type":"ContainerStarted","Data":"63d446c0d1459ef39acc4bde16fc202c2dcfa62138553e3c20e62c77e033a6f4"}
Jul 21 02:23:02.439300 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:02.438936    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:02.455105 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:02.455053    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn" podStartSLOduration=1.455038243 podStartE2EDuration="1.455038243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:23:02.452992255 +0000 UTC m=+2799.297985871" watchObservedRunningTime="2026-07-21 02:23:02.455038243 +0000 UTC m=+2799.300031839"
Jul 21 02:23:04.244752 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:04.244720    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5sqg_bb9c1459-86cb-4bf3-94fa-195a22db4f98/dns/0.log"
Jul 21 02:23:04.270511 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:04.270487    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5sqg_bb9c1459-86cb-4bf3-94fa-195a22db4f98/kube-rbac-proxy/0.log"
Jul 21 02:23:04.440513 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:04.440486    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d5w56_9d05c403-0eb3-48c4-8c89-123b9ddcfec0/dns-node-resolver/0.log"
Jul 21 02:23:05.053775 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:05.053740    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dn56p_90673ea3-b76b-4942-8087-b7e19186ea4c/node-ca/0.log"
Jul 21 02:23:06.097589 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:06.097562    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678tbmj7_aa2d4440-3482-47d3-9a6a-e48499a19c49/istio-proxy/0.log"
Jul 21 02:23:06.222072 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:06.222047    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lqltt_db456430-6275-4aad-b6a6-a56f3686230d/discovery/0.log"
Jul 21 02:23:07.147186 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:07.147152    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nbrz_d33e2be7-7714-42e2-901e-2a0a015905f3/serve-healthcheck-canary/0.log"
Jul 21 02:23:07.800426 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:07.800398    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7x495_197fe718-567e-475b-b585-c4d6e42f3e07/kube-rbac-proxy/0.log"
Jul 21 02:23:07.825434 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:07.825405    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7x495_197fe718-567e-475b-b585-c4d6e42f3e07/exporter/0.log"
Jul 21 02:23:07.853712 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:07.853682    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7x495_197fe718-567e-475b-b585-c4d6e42f3e07/extractor/0.log"
Jul 21 02:23:08.453146 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:08.453118    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gfbpz/perf-node-gather-daemonset-wsbcn"
Jul 21 02:23:10.915986 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:10.915959    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm_06191940-2bce-416c-abe3-8a3eeb36a148/manager/0.log"
Jul 21 02:23:10.939758 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:10.939731    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7c89d5b6-gcqjm_06191940-2bce-416c-abe3-8a3eeb36a148/copy-manifests/0.log"
Jul 21 02:23:11.998206 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:11.998178    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678tbmj7_aa2d4440-3482-47d3-9a6a-e48499a19c49/istio-proxy/0.log"
Jul 21 02:23:12.125327 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:12.125282    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lqltt_db456430-6275-4aad-b6a6-a56f3686230d/discovery/0.log"
Jul 21 02:23:12.248477 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:12.248385    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-95964d979-pzkxn_37bdaf16-515a-4c28-aaba-6f803174d6b9/manager/0.log"
Jul 21 02:23:13.548639 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:13.548610    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678tbmj7_aa2d4440-3482-47d3-9a6a-e48499a19c49/istio-proxy/0.log"
Jul 21 02:23:13.670384 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:13.670345    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lqltt_db456430-6275-4aad-b6a6-a56f3686230d/discovery/0.log"
Jul 21 02:23:17.475528 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:17.475500    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ngbn5_92bf5747-a01f-4a48-8341-30b72ba29f6b/migrator/0.log"
Jul 21 02:23:17.497180 ip-10-0-138-80 kubenswrapper[2568]: I0721 02:23:17.497142    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-ngbn5_92bf5747-a01f-4a48-8341-30b72ba29f6b/graceful-termination/0.log"