Jul 23 17:57:38.063064 ip-10-0-129-70 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.382572    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387073    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387091    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387097    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387102    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387107    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387111    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387115    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:38.387583 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387120    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387128    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387132    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387137    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387143    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387147    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387149    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387152    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387156    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387159    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387162    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387165    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387169    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387172    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387175    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387181    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387185    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387188    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387192    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:38.402486 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387196    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387199    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387205    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387209    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387212    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387215    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387219    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387221    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387224    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387227    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387230    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387234    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387237    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387240    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387243    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387246    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387249    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387251    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387255    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:38.453891 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387259    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:38.447481 ip-10-0-129-70 systemd[1]: Started Kubernetes Kubelet.
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387263    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387268    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387272    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387274    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387278    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387283    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387287    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387291    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387294    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387301    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387306    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387309    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387313    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387317    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387319    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387322    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387327    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387330    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:38.598251 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387333    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387337    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387340    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387343    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387345    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387349    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387352    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387354    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387357    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387361    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387364    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387366    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387369    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387373    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387376    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387378    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387381    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387385    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387388    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387390    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:38.605479 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387393    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387397    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387399    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387402    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387405    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387409    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387411    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387414    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387418    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387420    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387423    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387426    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387429    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387431    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.387434    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388180    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388188    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388191    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388194    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388197    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:38.607008 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388200    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388204    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388206    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388209    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388212    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388214    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388217    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388219    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388222    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388225    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388227    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388230    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388244    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388248    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388251    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388254    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388257    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388259    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388262    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388264    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:38.608073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388267    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388270    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388273    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388276    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388280    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388282    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388285    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388288    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388290    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388293    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388296    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388298    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388301    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388304    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388308    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388311    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388314    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388317    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388320    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388323    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:38.609155 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388326    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388328    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388331    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388334    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388336    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388339    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388342    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388344    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388347    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388351    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388354    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388356    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388359    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388362    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388365    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388368    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388370    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388379    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388382    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:38.610030 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388384    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388388    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388391    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388394    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388397    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388400    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388403    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388407    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388411    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388414    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388417    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388420    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388423    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388427    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388429    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388433    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388438    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388441    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388444    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:38.610897 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388447    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388450    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388453    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388456    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388459    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388462    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388465    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388469    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388472    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388474    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388478    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388481    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388485    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388489    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388492    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388495    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388896    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388902    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388905    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388908    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:38.611706 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388910    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388913    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388916    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388918    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388921    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388923    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388925    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388928    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388931    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388933    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388936    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388939    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388943    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388947    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388950    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388954    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388958    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388961    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388964    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:38.612508 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388967    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388969    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388972    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388974    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388977    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388982    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388986    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388988    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388991    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388994    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.388997    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389000    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389002    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389005    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389007    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389010    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389013    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389018    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389020    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:38.613372 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389023    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389026    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389029    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389031    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389034    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389037    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389040    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389042    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389044    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389047    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389050    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389052    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389055    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389058    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389061    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389064    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389067    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389070    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389073    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:38.614238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389076    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389078    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389081    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389084    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389086    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389089    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389091    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389093    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389096    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389099    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389101    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389105    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389108    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389110    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389113    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389115    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389118    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389120    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389123    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389126    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:38.615118 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389128    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389131    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389133    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389136    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389138    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389141    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389143    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389146    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389148    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389150    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389153    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389156    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389158    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389161    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389163    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389166    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389168    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389171    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389238    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389245    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389251    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 17:57:38.615994 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389259    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389265    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389271    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389279    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389283    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389287    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389290    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389293    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389296    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389300    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389303    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389306    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389309    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389311    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389314    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389319    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389321    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389324    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389328    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389331    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389335    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389338    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389341    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 17:57:38.616863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389344    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389348    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389351    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389354    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389358    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389360    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389364    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389367    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389370    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389374    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389377    2572 flags.go:64] FLAG: --enable-server="true"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389381    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389385    2572 flags.go:64] FLAG: --event-burst="100"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389388    2572 flags.go:64] FLAG: --event-qps="50"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389391    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389394    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389397    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389400    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389403    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389406    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389409    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389412    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389415    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389418    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389421    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 17:57:38.618055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389423    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389426    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389429    2572 flags.go:64] FLAG: --feature-gates=""
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389432    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389435    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389438    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389442    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389445    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389447    2572 flags.go:64] FLAG: --help="false"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389450    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-129-70.ec2.internal"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389454    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389457    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389460    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389463    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389466    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389469    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389473    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389476    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389482    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389484    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389487    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389491    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389493    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389496    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 17:57:38.619291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389499    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389502    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389506    2572 flags.go:64] FLAG: --lock-file=""
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389508    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389511    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389514    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389519    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389522    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389525    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389528    2572 flags.go:64] FLAG: --logging-format="text"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389530    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389534    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389536    2572 flags.go:64] FLAG: --manifest-url=""
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389539    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389543    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389546    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389550    2572 flags.go:64] FLAG: --max-pods="110"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389553    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389556    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389560    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389563    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389566    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389568    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389571    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389580    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 17:57:38.620984 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389583    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389587    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389590    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389593    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389598    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389601    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389604    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389607    2572 flags.go:64] FLAG: --port="10250"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389610    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389613    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0820f93cf672baf7f"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389616    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389619    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389623    2572 flags.go:64] FLAG: --register-node="true"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389626    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389629    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389631    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389634    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389637    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389640    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389643    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389646    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389649    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389652    2572 flags.go:64] FLAG: --runonce="false"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389654    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389657    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 17:57:38.623848 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389660    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389663    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389666    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389669    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389672    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389675    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389679    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389682    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389685    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389688    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389691    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389694    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389697    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389702    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389705    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389708    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389711    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389714    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389717    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389720    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389723    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389726    2572 flags.go:64] FLAG: --v="2"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389730    2572 flags.go:64] FLAG: --version="false"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389734    2572 flags.go:64] FLAG: --vmodule=""
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389737    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 17:57:38.626012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.389740    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389897    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389902    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389905    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389908    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389911    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389914    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389917    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389920    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389924    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389927    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389930    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389932    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389936    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389939    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389941    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389946    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389948    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389951    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:38.628163 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389953    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389956    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389959    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389961    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389964    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389966    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389969    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389972    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389974    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389977    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389979    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389982    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389985    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389987    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389989    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389992    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389994    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389997    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.389999    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390002    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:38.629183 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390004    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390007    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390010    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390013    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390015    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390018    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390022    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390025    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390028    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390033    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390037    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390039    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390042    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390045    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390048    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390050    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390053    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390056    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390059    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:38.634375 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390061    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390064    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390066    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390069    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390071    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390074    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390076    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390079    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390081    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390084    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390086    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390088    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390091    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390094    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390098    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390101    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390104    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390107    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390110    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:38.635238 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390114    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390117    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390119    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390125    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390127    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390130    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390132    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390135    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390138    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390140    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390143    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390145    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390148    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390150    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390153    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390155    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390158    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390161    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390163    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390166    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:38.636518 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390169    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390171    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.390173    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.390648    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.398581    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.398598    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.399135    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.399143    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399207    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399213    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399217    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399220    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399223    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399226    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399230    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:38.637397 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399233    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399236    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399239    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399243    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399248    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399253    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399257    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399262    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399265    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399267    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399270    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399273    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399276    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399278    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399281    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399284    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399287    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399289    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399308    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:38.638454 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399311    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399314    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399319    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399324    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399329    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399334    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399339    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399344    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399347    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399350    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399353    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399356    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399359    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399361    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399364    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399367    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399369    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399372    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399375    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399378    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:38.639328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399381    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399384    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399387    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399389    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399392    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399394    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399397    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399400    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399402    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399406    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399410    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399414    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399418    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399423    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399426    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399428    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399432    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399436    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399439    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399442    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:38.643702 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399445    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399448    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399451    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399454    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399456    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399459    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399462    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399465    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399468    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399470    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399473    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399475    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399478    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399481    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399485    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399490    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399494    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399498    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399502    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:38.644574 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399504    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399507    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399509    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399513    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399515    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399518    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399524    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399526    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399529    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399531    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399534    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399536    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399539    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399542    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.399547    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 17:57:38.646047 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399682    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399689    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399692    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399695    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399698    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399701    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399703    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399706    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399708    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399711    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399713    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399716    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399719    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399726    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399732    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399736    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399740    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399743    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399745    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399762    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 17:57:38.646710 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399765    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399768    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399770    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399773    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399777    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399780    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399783    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399785    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399789    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399793    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399797    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399800    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399804    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399808    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399812    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399816    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399821    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399823    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399826    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399828    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 17:57:38.647998 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399831    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399834    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399836    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399838    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399842    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399849    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399852    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399855    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399857    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399860    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399863    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399865    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399868    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399870    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399873    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399875    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399879    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399882    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399885    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 17:57:38.829073 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399888    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399890    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399893    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399896    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399898    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399902    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399907    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399911    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399915    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399919    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399923    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399926    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399929    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399932    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399935    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399937    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399940    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399942    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399946    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 17:57:38.851666 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399950    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399953    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399955    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399958    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399960    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399963    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399966    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399968    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399971    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399973    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399978    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399980    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399983    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399985    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399988    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399990    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399993    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399996    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.399998    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.400000    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 17:57:38.852304 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:38.400003    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.400008    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.400120    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.403683    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.405037    2572 server.go:1019] "Starting client certificate rotation"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.405143    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.405182    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.407104    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.410687    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.417862    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.420509    2572 log.go:25] "Validated CRI v1 image API"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.421780    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 17:57:38.853055 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.423570    2572 fs.go:135] Filesystem UUIDs: map[15ddb01e-fdd0-437c-884a-3adf1342fe3f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d68981cb-f719-4125-ab77-de214df336d7:/dev/nvme0n1p3]
Jul 23 17:57:38.853490 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.423590    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 17:57:38.853591 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.429354    2572 manager.go:216] Machine: {Timestamp:2026-07-23 17:57:38.42831205 +0000 UTC m=+0.261003199 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099444 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d829b92a91333bfe13ce2c43115a SystemUUID:ec22d829-b92a-9133-3bfe-13ce2c43115a BootID:0b110657-7edb-41d6-9419-1bcc45b863ca Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:c8:b0:70:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:c8:b0:70:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:6c:f8:d7:ac:b9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 17:57:38.853591 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.429448    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 17:57:38.853591 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.429522    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 17:57:38.853591 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.431788    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 17:57:38.853591 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.431820    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 17:57:38.853591 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.432438    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 17:57:38.853591 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.432447    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 17:57:38.853591 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.432455    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.433112    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.433436    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.434660    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438200    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438312    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438338    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438347    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438361    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438369    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438378    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438698    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.438715    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.440379    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.442136    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.442162    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443098    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443111    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443116    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443122    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443131    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443137    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443145    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443150    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443158    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443166    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443174    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443181    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443719    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.443727    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.446737    2572 server.go:1268] "Started kubelet"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.446850    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.446837    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.446927    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.448333    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.448595    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.449845    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.450325    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.450325    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 17:57:38.854069 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.454502    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.456383    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-70.ec2.internal.18c4fcef9f5e7c22  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-70.ec2.internal,UID:ip-10-0-129-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-70.ec2.internal,},FirstTimestamp:2026-07-23 17:57:38.446711842 +0000 UTC m=+0.279402992,LastTimestamp:2026-07-23 17:57:38.446711842 +0000 UTC m=+0.279402992,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-70.ec2.internal,}"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.462918    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dbw2p"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.469041    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dbw2p"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.598189    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.598795    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.599903    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.600219    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.600224    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.600237    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.600356    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.600362    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.606045    2572 factory.go:55] Registering systemd factory
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.606058    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.606283    2572 factory.go:153] Registering CRI-O factory
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.606295    2572 factory.go:223] Registration of the crio container factory successfully
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.606344    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.606366    2572 factory.go:103] Registering Raw factory
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.606378    2572 manager.go:1196] Started watching for new ooms in manager
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.606734    2572 manager.go:349] Starting recovery of all containers
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.612063    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.612082    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.657122    2572 manager.go:354] Recovery completed
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.661191    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.663181    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.663209    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.663219    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.663677    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.663690    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.663696    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.663709    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.664361    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:38.855139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.664385    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.664394    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.665953    2572 policy_none.go:49] "None policy: Start"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.665972    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.665988    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.668084    2572 policy_none.go:47] "Start"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.700794    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.707267    2572 manager.go:337] "Starting Device Plugin manager"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.707293    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.707302    2572 server.go:87] "Starting device plugin registration server"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.707543    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.707557    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.707643    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.707713    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.707722    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.708156    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.708196    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.784907    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.786177    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.786217    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.786243    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.786277    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.788661    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.808134    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.812414    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.812449    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.812459    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.812483    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-70.ec2.internal"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.819261    2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-70.ec2.internal\" not found" node="ip-10-0-129-70.ec2.internal"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.820407    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-70.ec2.internal"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.820424    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-70.ec2.internal\": node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:38.856205 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.839995    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.886981    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal"]
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.887043    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.888043    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.888073    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.888084    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.890482    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.890642    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.890680    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.891131    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.891161    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.891168    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.891175    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.891186    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.891196    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.893469    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.893491    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.894132    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.894163    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.894175    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeHasSufficientPID"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.901485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/000e9bb5607575f5cb60224ba858851f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal\" (UID: \"000e9bb5607575f5cb60224ba858851f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.901508    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/000e9bb5607575f5cb60224ba858851f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal\" (UID: \"000e9bb5607575f5cb60224ba858851f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:38.901526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be78cfb9e61c5f94e698648d53053e99-config\") pod \"kube-apiserver-proxy-ip-10-0-129-70.ec2.internal\" (UID: \"be78cfb9e61c5f94e698648d53053e99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.921411    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-70.ec2.internal\" not found" node="ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.927217    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-70.ec2.internal\" not found" node="ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.046905 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:38.940354    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:39.047866 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.001840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be78cfb9e61c5f94e698648d53053e99-config\") pod \"kube-apiserver-proxy-ip-10-0-129-70.ec2.internal\" (UID: \"be78cfb9e61c5f94e698648d53053e99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.047866 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.001866    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/000e9bb5607575f5cb60224ba858851f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal\" (UID: \"000e9bb5607575f5cb60224ba858851f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.047866 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.001884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/000e9bb5607575f5cb60224ba858851f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal\" (UID: \"000e9bb5607575f5cb60224ba858851f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.047866 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.001912    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/000e9bb5607575f5cb60224ba858851f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal\" (UID: \"000e9bb5607575f5cb60224ba858851f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.047866 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.001929    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be78cfb9e61c5f94e698648d53053e99-config\") pod \"kube-apiserver-proxy-ip-10-0-129-70.ec2.internal\" (UID: \"be78cfb9e61c5f94e698648d53053e99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.047866 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.001944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/000e9bb5607575f5cb60224ba858851f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal\" (UID: \"000e9bb5607575f5cb60224ba858851f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.047866 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.041327    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:39.238524 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.142390    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:39.238524 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.224852    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.238524 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.230032    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.433048 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.243803    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-70.ec2.internal\" not found"
Jul 23 17:57:39.433048 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.339642    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:39.433048 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.399938    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.433048 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.404573    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 17:57:39.433048 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.404685    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 17:57:39.433048 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.404728    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 17:57:39.433048 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.404752    2572 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://ae7bb08bc70a4477c953dcd137781703-aa524030cb99a9a5.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.129.70:37210->44.214.110.89:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.433048 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.404811    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.437226    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.438682    2572 apiserver.go:52] "Watching apiserver"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.449737    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.451240    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr","openshift-cluster-node-tuning-operator/tuned-kkcjf","openshift-image-registry/node-ca-bqk5j","openshift-multus/network-metrics-daemon-4ph55","openshift-ovn-kubernetes/ovnkube-node-k8wgd","kube-system/global-pull-secret-syncer-mcqzn","kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal","openshift-dns/node-resolver-wqhlk","openshift-multus/multus-additional-cni-plugins-266bn","openshift-multus/multus-j8hj9","openshift-network-diagnostics/network-check-target-sh98p","openshift-network-operator/iptables-alerter-b2lbg","kube-system/konnectivity-agent-gxdbb"]
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.453900    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.456635    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.458881    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.460125    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.460946    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.460951    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.461247    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwxqh\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.461261    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.461319    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2c8v8\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.461325    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.461546    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.462194    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.462417    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.462635    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.462732    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7kz72\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.462861    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.462967    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.464348    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.466187    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.466239    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.468502    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.603509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.470912    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.471995    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.472776    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.472799    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.472851    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.473205    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.473589    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c6z4k\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.473639    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.473590    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.473694    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.474109    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.474135    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.474185    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.475104    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6c7n8\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.475140    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zngnw\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.475531    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.475570    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.478390    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.479058    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.479198    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.479300    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.479519    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9qpgt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.480428    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.480974    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.481135    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.481487    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.481784    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zz257\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.483038    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4g46k\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.483338    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.483425    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 17:57:39.605214 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.501525    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84e0abd7-c74a-4e95-83bd-ca41a57c735a-host-slash\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-var-lib-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504107    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6004c343-fd6c-4f9d-af11-f014ad66a2d4-agent-certs\") pod \"konnectivity-agent-gxdbb\" (UID: \"6004c343-fd6c-4f9d-af11-f014ad66a2d4\") " pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504125    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-cni-bin\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-device-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504206    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-host\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-run-netns\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504241    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovnkube-config\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504256    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22283f03-b1b4-4866-91bd-f1542d68df2b-dbus\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks4zt\" (UniqueName: \"kubernetes.io/projected/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-kube-api-access-ks4zt\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysconfig\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504303    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-kubernetes\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.607093 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504318    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysctl-conf\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504349    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cplj\" (UniqueName: \"kubernetes.io/projected/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-kube-api-access-2cplj\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504364    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-kubelet\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504380    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504396    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbxwx\" (UniqueName: \"kubernetes.io/projected/bf158ea0-13be-4e89-aaed-bb5d885fc798-kube-api-access-xbxwx\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dth7\" (UniqueName: \"kubernetes.io/projected/69a29389-c968-4e40-a920-7c5caea45328-kube-api-access-4dth7\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3948691-c50e-4038-bede-73ef860778db-host\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6004c343-fd6c-4f9d-af11-f014ad66a2d4-konnectivity-ca\") pod \"konnectivity-agent-gxdbb\" (UID: \"6004c343-fd6c-4f9d-af11-f014ad66a2d4\") " pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-system-cni-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504488    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-hostroot\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504503    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3948691-c50e-4038-bede-73ef860778db-serviceca\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504531    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-etc-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.608255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504575    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504593    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504611    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-cni-multus\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504635    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-multus-certs\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-var-lib-kubelet\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504672    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69a29389-c968-4e40-a920-7c5caea45328-etc-tuned\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69a29389-c968-4e40-a920-7c5caea45328-tmp\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504702    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt6kq\" (UniqueName: \"kubernetes.io/projected/b3948691-c50e-4038-bede-73ef860778db-kube-api-access-wt6kq\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504717    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-slash\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-cni-netd\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504747    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-env-overrides\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504781    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl4pb\" (UniqueName: \"kubernetes.io/projected/af21b217-5075-4d30-92d1-e06c905de394-kube-api-access-bl4pb\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-ovn\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504822    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovn-node-metrics-cert\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.609187 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-cni-binary-copy\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504889    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-os-release\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504904    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-netns\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-etc-kubernetes\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-modprobe-d\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.504993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84e0abd7-c74a-4e95-83bd-ca41a57c735a-iptables-alerter-script\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-cni-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-socket-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-system-cni-dir\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-os-release\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505131    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-cnibin\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.610117 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-socket-dir-parent\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-systemd\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-lib-modules\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505227    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-daemon-config\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505248    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysctl-d\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-systemd-units\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505294    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc29980-1bd1-463b-8fe7-3a6be20750c8-tmp-dir\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27879\" (UniqueName: \"kubernetes.io/projected/abc29980-1bd1-463b-8fe7-3a6be20750c8-kube-api-access-27879\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-cni-bin\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-sys\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovnkube-script-lib\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-sys-fs\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505404    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tvxz\" (UniqueName: \"kubernetes.io/projected/84e0abd7-c74a-4e95-83bd-ca41a57c735a-kube-api-access-7tvxz\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.612390 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-cni-binary-copy\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-kubelet\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-conf-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-systemd\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505512    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-registration-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bm96\" (UniqueName: \"kubernetes.io/projected/bd748a4c-0a35-426e-8352-9a3f0530edf8-kube-api-access-4bm96\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.505550    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abc29980-1bd1-463b-8fe7-3a6be20750c8-hosts-file\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.506001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.506067    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-k8s-cni-cncf-io\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.506109    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-run\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.506143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-node-log\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.506189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-log-socket\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.506226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22283f03-b1b4-4866-91bd-f1542d68df2b-kubelet-config\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.506264    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-cnibin\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.613527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.598299    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606731    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3948691-c50e-4038-bede-73ef860778db-serviceca\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-etc-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606802    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-cni-multus\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606864    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-multus-certs\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606888    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-etc-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-var-lib-kubelet\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606905    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606928    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69a29389-c968-4e40-a920-7c5caea45328-etc-tuned\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-cni-multus\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606961    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69a29389-c968-4e40-a920-7c5caea45328-tmp\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606988    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt6kq\" (UniqueName: \"kubernetes.io/projected/b3948691-c50e-4038-bede-73ef860778db-kube-api-access-wt6kq\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.615137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606965    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-multus-certs\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607032    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-slash\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607062    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-cni-netd\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607092    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-env-overrides\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl4pb\" (UniqueName: \"kubernetes.io/projected/af21b217-5075-4d30-92d1-e06c905de394-kube-api-access-bl4pb\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607161    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-ovn\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovn-node-metrics-cert\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607228    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-cni-netd\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607240    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607258    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607285    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-slash\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607310    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-ovn\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607317    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-cni-binary-copy\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607347    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-os-release\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607360    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b3948691-c50e-4038-bede-73ef860778db-serviceca\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.616065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-netns\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607402    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-etc-kubernetes\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-modprobe-d\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607455    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607457    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607497    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84e0abd7-c74a-4e95-83bd-ca41a57c735a-iptables-alerter-script\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-cni-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.607538    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-socket-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.607597    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret podName:22283f03-b1b4-4866-91bd-f1542d68df2b nodeName:}" failed. No retries permitted until 2026-07-23 17:57:40.107576512 +0000 UTC m=+1.940267669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret") pod "global-pull-secret-syncer-mcqzn" (UID: "22283f03-b1b4-4866-91bd-f1542d68df2b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-system-cni-dir\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607648    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-env-overrides\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607653    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-os-release\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.625041 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607677    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-socket-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607701    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-cnibin\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607707    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-os-release\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-socket-dir-parent\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607748    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-systemd\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-lib-modules\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607791    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-daemon-config\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607814    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysctl-d\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-systemd-units\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607873    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-cni-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc29980-1bd1-463b-8fe7-3a6be20750c8-tmp-dir\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607924    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27879\" (UniqueName: \"kubernetes.io/projected/abc29980-1bd1-463b-8fe7-3a6be20750c8-kube-api-access-27879\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.607983    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-cni-bin\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-sys\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.626189 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovnkube-script-lib\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-sys-fs\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608087    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608114    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tvxz\" (UniqueName: \"kubernetes.io/projected/84e0abd7-c74a-4e95-83bd-ca41a57c735a-kube-api-access-7tvxz\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-cni-binary-copy\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608149    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc29980-1bd1-463b-8fe7-3a6be20750c8-tmp-dir\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-kubelet\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608222    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-conf-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608229    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-cnibin\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608264    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-systemd\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608276    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-socket-dir-parent\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608289    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-cni-binary-copy\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608293    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-registration-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608318    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-run-systemd\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608374    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-registration-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.627770 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608375    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-os-release\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bm96\" (UniqueName: \"kubernetes.io/projected/bd748a4c-0a35-426e-8352-9a3f0530edf8-kube-api-access-4bm96\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abc29980-1bd1-463b-8fe7-3a6be20750c8-hosts-file\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608458    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84e0abd7-c74a-4e95-83bd-ca41a57c735a-iptables-alerter-script\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608489    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-k8s-cni-cncf-io\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-run\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-node-log\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-log-socket\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-cni-bin\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22283f03-b1b4-4866-91bd-f1542d68df2b-kubelet-config\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608627    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-cnibin\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-sys\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84e0abd7-c74a-4e95-83bd-ca41a57c735a-host-slash\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.628696 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608691    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-var-lib-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6004c343-fd6c-4f9d-af11-f014ad66a2d4-agent-certs\") pod \"konnectivity-agent-gxdbb\" (UID: \"6004c343-fd6c-4f9d-af11-f014ad66a2d4\") " pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608744    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-cni-bin\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-device-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608795    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608812    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-host\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608809    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-daemon-config\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608885    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-etc-kubernetes\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608907    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-run-netns\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608955    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-netns\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608947    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-modprobe-d\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609062    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysctl-d\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609104    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-systemd-units\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.608849    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-run-netns\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609141    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-system-cni-dir\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.630060 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovnkube-config\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609264    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-cni-binary-copy\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609369    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-sys-fs\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609365    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abc29980-1bd1-463b-8fe7-3a6be20750c8-hosts-file\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609680    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovnkube-script-lib\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609714    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-multus-conf-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609721    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovnkube-config\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609747    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-systemd\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609774    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-var-lib-kubelet\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609848    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-var-lib-openvswitch\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609857    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-lib-modules\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609905    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-node-log\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609909    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-run\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609955    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-host-run-k8s-cni-cncf-io\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609958    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.631195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.609975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-log-socket\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610012    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22283f03-b1b4-4866-91bd-f1542d68df2b-kubelet-config\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610024    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84e0abd7-c74a-4e95-83bd-ca41a57c735a-host-slash\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-cnibin\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610090    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-host\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.606997    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-var-lib-kubelet\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610374    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-cni-bin\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610411    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22283f03-b1b4-4866-91bd-f1542d68df2b-dbus\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd748a4c-0a35-426e-8352-9a3f0530edf8-device-dir\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610441    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks4zt\" (UniqueName: \"kubernetes.io/projected/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-kube-api-access-ks4zt\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610470    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysconfig\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-kubernetes\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610505    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22283f03-b1b4-4866-91bd-f1542d68df2b-dbus\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610523    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysctl-conf\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610554    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:39.632804 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610564    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysconfig\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cplj\" (UniqueName: \"kubernetes.io/projected/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-kube-api-access-2cplj\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-kubelet\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbxwx\" (UniqueName: \"kubernetes.io/projected/bf158ea0-13be-4e89-aaed-bb5d885fc798-kube-api-access-xbxwx\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dth7\" (UniqueName: \"kubernetes.io/projected/69a29389-c968-4e40-a920-7c5caea45328-kube-api-access-4dth7\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610712    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3948691-c50e-4038-bede-73ef860778db-host\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6004c343-fd6c-4f9d-af11-f014ad66a2d4-konnectivity-ca\") pod \"konnectivity-agent-gxdbb\" (UID: \"6004c343-fd6c-4f9d-af11-f014ad66a2d4\") " pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610764    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610793    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-system-cni-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-kubelet\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610818    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-hostroot\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-kubernetes\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610923    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf158ea0-13be-4e89-aaed-bb5d885fc798-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610938    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 17:52:39 +0000 UTC" deadline="2028-02-22 15:08:09.088484946 +0000 UTC"
Jul 23 17:57:39.633709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.610978    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13893h10m29.477511345s"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69a29389-c968-4e40-a920-7c5caea45328-etc-sysctl-conf\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af21b217-5075-4d30-92d1-e06c905de394-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611069    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3948691-c50e-4038-bede-73ef860778db-host\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69a29389-c968-4e40-a920-7c5caea45328-etc-tuned\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611145    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-system-cni-dir\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611186    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-hostroot\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611215    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af21b217-5075-4d30-92d1-e06c905de394-tuning-conf-dir\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.611265    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.611322    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs podName:535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:40.111305878 +0000 UTC m=+1.943997034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs") pod "network-metrics-daemon-4ph55" (UID: "535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69a29389-c968-4e40-a920-7c5caea45328-tmp\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.611627    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6004c343-fd6c-4f9d-af11-f014ad66a2d4-konnectivity-ca\") pod \"konnectivity-agent-gxdbb\" (UID: \"6004c343-fd6c-4f9d-af11-f014ad66a2d4\") " pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.612949    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6004c343-fd6c-4f9d-af11-f014ad66a2d4-agent-certs\") pod \"konnectivity-agent-gxdbb\" (UID: \"6004c343-fd6c-4f9d-af11-f014ad66a2d4\") " pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.613180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf158ea0-13be-4e89-aaed-bb5d885fc798-ovn-node-metrics-cert\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.615950    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.618786    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:39.635110 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.618802    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.618812    2572 projected.go:196] Error preparing data for projected volume kube-api-access-hncdt for pod openshift-network-diagnostics/network-check-target-sh98p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:39.618885    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt podName:77cfedf5-9699-4fc6-bf99-a79c273f966d nodeName:}" failed. No retries permitted until 2026-07-23 17:57:40.118871381 +0000 UTC m=+1.951562519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hncdt" (UniqueName: "kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt") pod "network-check-target-sh98p" (UID: "77cfedf5-9699-4fc6-bf99-a79c273f966d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.621654    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27879\" (UniqueName: \"kubernetes.io/projected/abc29980-1bd1-463b-8fe7-3a6be20750c8-kube-api-access-27879\") pod \"node-resolver-wqhlk\" (UID: \"abc29980-1bd1-463b-8fe7-3a6be20750c8\") " pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.621836    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cplj\" (UniqueName: \"kubernetes.io/projected/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-kube-api-access-2cplj\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.622237    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tvxz\" (UniqueName: \"kubernetes.io/projected/84e0abd7-c74a-4e95-83bd-ca41a57c735a-kube-api-access-7tvxz\") pod \"iptables-alerter-b2lbg\" (UID: \"84e0abd7-c74a-4e95-83bd-ca41a57c735a\") " pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.622400    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt6kq\" (UniqueName: \"kubernetes.io/projected/b3948691-c50e-4038-bede-73ef860778db-kube-api-access-wt6kq\") pod \"node-ca-bqk5j\" (UID: \"b3948691-c50e-4038-bede-73ef860778db\") " pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.622902    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bm96\" (UniqueName: \"kubernetes.io/projected/bd748a4c-0a35-426e-8352-9a3f0530edf8-kube-api-access-4bm96\") pod \"aws-ebs-csi-driver-node-gn6tr\" (UID: \"bd748a4c-0a35-426e-8352-9a3f0530edf8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.623820    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl4pb\" (UniqueName: \"kubernetes.io/projected/af21b217-5075-4d30-92d1-e06c905de394-kube-api-access-bl4pb\") pod \"multus-additional-cni-plugins-266bn\" (UID: \"af21b217-5075-4d30-92d1-e06c905de394\") " pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.624427    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dth7\" (UniqueName: \"kubernetes.io/projected/69a29389-c968-4e40-a920-7c5caea45328-kube-api-access-4dth7\") pod \"tuned-kkcjf\" (UID: \"69a29389-c968-4e40-a920-7c5caea45328\") " pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.624667    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks4zt\" (UniqueName: \"kubernetes.io/projected/86684ec3-a9a4-4242-ae3b-1c58d91b5fdb-kube-api-access-ks4zt\") pod \"multus-j8hj9\" (UID: \"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb\") " pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.635704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.624693    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbxwx\" (UniqueName: \"kubernetes.io/projected/bf158ea0-13be-4e89-aaed-bb5d885fc798-kube-api-access-xbxwx\") pod \"ovnkube-node-k8wgd\" (UID: \"bf158ea0-13be-4e89-aaed-bb5d885fc798\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.792655 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.642747    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c6bhm"
Jul 23 17:57:39.792655 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.653222    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c6bhm"
Jul 23 17:57:39.792655 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.661605    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr"
Jul 23 17:57:39.792655 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.674084    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:39.792655 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.687423    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b2lbg"
Jul 23 17:57:39.792655 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.692805    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:57:39.792655 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.734577    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:39.798324 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.796098    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j8hj9"
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.815856    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kkcjf"
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.850315    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bqk5j"
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.859931    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:39.860033    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000e9bb5607575f5cb60224ba858851f.slice/crio-437f2f9d188427637c6366cb6af98fddf79baf4468d745dd6de06ce192b0af6e WatchSource:0}: Error finding container 437f2f9d188427637c6366cb6af98fddf79baf4468d745dd6de06ce192b0af6e: Status 404 returned error can't find the container with id 437f2f9d188427637c6366cb6af98fddf79baf4468d745dd6de06ce192b0af6e
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:39.862492    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86684ec3_a9a4_4242_ae3b_1c58d91b5fdb.slice/crio-c36ea4c33893ec58205589b38b15fdbf6f630d26ee511d906d99e3aca8603c96 WatchSource:0}: Error finding container c36ea4c33893ec58205589b38b15fdbf6f630d26ee511d906d99e3aca8603c96: Status 404 returned error can't find the container with id c36ea4c33893ec58205589b38b15fdbf6f630d26ee511d906d99e3aca8603c96
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.868172    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:39.870915    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3948691_c50e_4038_bede_73ef860778db.slice/crio-a5deb674da23fff1c4ba09916d9a1a88a05df01e4f7b3d9fc142a8a053968554 WatchSource:0}: Error finding container a5deb674da23fff1c4ba09916d9a1a88a05df01e4f7b3d9fc142a8a053968554: Status 404 returned error can't find the container with id a5deb674da23fff1c4ba09916d9a1a88a05df01e4f7b3d9fc142a8a053968554
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:39.876670    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf158ea0_13be_4e89_aaed_bb5d885fc798.slice/crio-7839c6ca8860d1695e3c6f56346b4ad161bfc08a565cc38d35d42a69f451b2e8 WatchSource:0}: Error finding container 7839c6ca8860d1695e3c6f56346b4ad161bfc08a565cc38d35d42a69f451b2e8: Status 404 returned error can't find the container with id 7839c6ca8860d1695e3c6f56346b4ad161bfc08a565cc38d35d42a69f451b2e8
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.893144    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wqhlk"
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:39.897339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-266bn"
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:39.906207    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc29980_1bd1_463b_8fe7_3a6be20750c8.slice/crio-d05e2ce379649a0d8032422c2da3a6bed150b5f35be4605e1f2798ce81331b15 WatchSource:0}: Error finding container d05e2ce379649a0d8032422c2da3a6bed150b5f35be4605e1f2798ce81331b15: Status 404 returned error can't find the container with id d05e2ce379649a0d8032422c2da3a6bed150b5f35be4605e1f2798ce81331b15
Jul 23 17:57:39.965332 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:39.907855    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf21b217_5075_4d30_92d1_e06c905de394.slice/crio-78b492ce4b7a7dff866520c91b6ca402dad86b6319279388c6d657e67a0d1302 WatchSource:0}: Error finding container 78b492ce4b7a7dff866520c91b6ca402dad86b6319279388c6d657e67a0d1302: Status 404 returned error can't find the container with id 78b492ce4b7a7dff866520c91b6ca402dad86b6319279388c6d657e67a0d1302
Jul 23 17:57:40.142096 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:40.073969    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e0abd7_c74a_4e95_83bd_ca41a57c735a.slice/crio-5d8b71ed1569e030b2d3393ada4fa90d6b475be780492a7f77adf21da2c84f98 WatchSource:0}: Error finding container 5d8b71ed1569e030b2d3393ada4fa90d6b475be780492a7f77adf21da2c84f98: Status 404 returned error can't find the container with id 5d8b71ed1569e030b2d3393ada4fa90d6b475be780492a7f77adf21da2c84f98
Jul 23 17:57:40.142096 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.114707    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:40.142096 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.114750    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:40.142096 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.114856    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:40.142096 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.114872    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:40.142096 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.114922    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret podName:22283f03-b1b4-4866-91bd-f1542d68df2b nodeName:}" failed. No retries permitted until 2026-07-23 17:57:41.114908458 +0000 UTC m=+2.947599599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret") pod "global-pull-secret-syncer-mcqzn" (UID: "22283f03-b1b4-4866-91bd-f1542d68df2b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:40.142096 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.114937    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs podName:535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:41.114930599 +0000 UTC m=+2.947621736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs") pod "network-metrics-daemon-4ph55" (UID: "535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:40.142096 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:40.121549    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6004c343_fd6c_4f9d_af11_f014ad66a2d4.slice/crio-0c07d1ff54970e97c6b3c573e0d8842cb08a72b740966e34e1e2c00fd6713cf7 WatchSource:0}: Error finding container 0c07d1ff54970e97c6b3c573e0d8842cb08a72b740966e34e1e2c00fd6713cf7: Status 404 returned error can't find the container with id 0c07d1ff54970e97c6b3c573e0d8842cb08a72b740966e34e1e2c00fd6713cf7
Jul 23 17:57:40.144762 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:57:40.142897    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd748a4c_0a35_426e_8352_9a3f0530edf8.slice/crio-7fa9b43c2c0da0558554286245e5ae38d01e14e28576017d0e6ad2756c69f733 WatchSource:0}: Error finding container 7fa9b43c2c0da0558554286245e5ae38d01e14e28576017d0e6ad2756c69f733: Status 404 returned error can't find the container with id 7fa9b43c2c0da0558554286245e5ae38d01e14e28576017d0e6ad2756c69f733
Jul 23 17:57:40.316204 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.215910    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:40.316204 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.216076    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:40.316204 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.216097    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:40.316204 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.216107    2572 projected.go:196] Error preparing data for projected volume kube-api-access-hncdt for pod openshift-network-diagnostics/network-check-target-sh98p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:40.316204 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.216157    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt podName:77cfedf5-9699-4fc6-bf99-a79c273f966d nodeName:}" failed. No retries permitted until 2026-07-23 17:57:41.216143759 +0000 UTC m=+3.048834900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hncdt" (UniqueName: "kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt") pod "network-check-target-sh98p" (UID: "77cfedf5-9699-4fc6-bf99-a79c273f966d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:40.657025 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.656914    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:52:40 +0000 UTC" deadline="2028-02-27 21:46:43.077940486 +0000 UTC"
Jul 23 17:57:40.657025 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.656958    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14019h49m2.420987722s"
Jul 23 17:57:40.789628 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.789587    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:40.789796 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.789728    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:40.790179 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.790157    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:40.790301 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.790258    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:40.790369 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.790329    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:40.790433 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:40.790415    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:40.820208 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.820180    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:40.829888 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.829799    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j8hj9" event={"ID":"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb","Type":"ContainerStarted","Data":"c36ea4c33893ec58205589b38b15fdbf6f630d26ee511d906d99e3aca8603c96"}
Jul 23 17:57:40.849242 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.849203    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal" event={"ID":"000e9bb5607575f5cb60224ba858851f","Type":"ContainerStarted","Data":"437f2f9d188427637c6366cb6af98fddf79baf4468d745dd6de06ce192b0af6e"}
Jul 23 17:57:40.860999 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.860969    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr" event={"ID":"bd748a4c-0a35-426e-8352-9a3f0530edf8","Type":"ContainerStarted","Data":"7fa9b43c2c0da0558554286245e5ae38d01e14e28576017d0e6ad2756c69f733"}
Jul 23 17:57:40.869479 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.869449    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b2lbg" event={"ID":"84e0abd7-c74a-4e95-83bd-ca41a57c735a","Type":"ContainerStarted","Data":"5d8b71ed1569e030b2d3393ada4fa90d6b475be780492a7f77adf21da2c84f98"}
Jul 23 17:57:40.881435 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.881407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wqhlk" event={"ID":"abc29980-1bd1-463b-8fe7-3a6be20750c8","Type":"ContainerStarted","Data":"d05e2ce379649a0d8032422c2da3a6bed150b5f35be4605e1f2798ce81331b15"}
Jul 23 17:57:40.889454 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.889415    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bqk5j" event={"ID":"b3948691-c50e-4038-bede-73ef860778db","Type":"ContainerStarted","Data":"a5deb674da23fff1c4ba09916d9a1a88a05df01e4f7b3d9fc142a8a053968554"}
Jul 23 17:57:40.906213 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.906182    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gxdbb" event={"ID":"6004c343-fd6c-4f9d-af11-f014ad66a2d4","Type":"ContainerStarted","Data":"0c07d1ff54970e97c6b3c573e0d8842cb08a72b740966e34e1e2c00fd6713cf7"}
Jul 23 17:57:40.929878 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.929671    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-266bn" event={"ID":"af21b217-5075-4d30-92d1-e06c905de394","Type":"ContainerStarted","Data":"78b492ce4b7a7dff866520c91b6ca402dad86b6319279388c6d657e67a0d1302"}
Jul 23 17:57:40.940476 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.940346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"7839c6ca8860d1695e3c6f56346b4ad161bfc08a565cc38d35d42a69f451b2e8"}
Jul 23 17:57:40.987845 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.984063    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal" event={"ID":"be78cfb9e61c5f94e698648d53053e99","Type":"ContainerStarted","Data":"35305894d5d99586e34ffd674c5c070edfcf183eba3d5f7d36ed2f95dbfa7629"}
Jul 23 17:57:40.989962 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:40.989935    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kkcjf" event={"ID":"69a29389-c968-4e40-a920-7c5caea45328","Type":"ContainerStarted","Data":"6a56378477223c2250fb09e5f38c9dd94d29016410c0a99dd61514f617fb8163"}
Jul 23 17:57:41.126580 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:41.125679    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:41.126580 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:41.125758    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:41.126580 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:41.125960    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:41.126580 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:41.126026    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret podName:22283f03-b1b4-4866-91bd-f1542d68df2b nodeName:}" failed. No retries permitted until 2026-07-23 17:57:43.126007737 +0000 UTC m=+4.958698881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret") pod "global-pull-secret-syncer-mcqzn" (UID: "22283f03-b1b4-4866-91bd-f1542d68df2b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:41.126580 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:41.126484    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:41.126580 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:41.126535    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs podName:535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:43.126519611 +0000 UTC m=+4.959210755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs") pod "network-metrics-daemon-4ph55" (UID: "535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:41.227497 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:41.227372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:41.231222 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:41.231192    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:41.231379 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:41.231241    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:41.231379 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:41.231257    2572 projected.go:196] Error preparing data for projected volume kube-api-access-hncdt for pod openshift-network-diagnostics/network-check-target-sh98p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:41.231379 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:41.231334    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt podName:77cfedf5-9699-4fc6-bf99-a79c273f966d nodeName:}" failed. No retries permitted until 2026-07-23 17:57:43.231312859 +0000 UTC m=+5.064004019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hncdt" (UniqueName: "kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt") pod "network-check-target-sh98p" (UID: "77cfedf5-9699-4fc6-bf99-a79c273f966d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:41.658218 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:41.658011    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:52:40 +0000 UTC" deadline="2027-12-22 07:51:12.569786006 +0000 UTC"
Jul 23 17:57:41.658218 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:41.658078    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12397h53m30.911712719s"
Jul 23 17:57:42.473671 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:42.473429    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 17:57:42.795953 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:42.794631    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:42.795953 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:42.795600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:42.795953 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:42.795704    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:42.795953 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:42.795772    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:42.795953 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:42.795858    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:42.800389 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:42.800348    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:43.143601 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:43.143511    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:43.143601 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:43.143583    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:43.143925 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:43.143709    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:43.143925 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:43.143773    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret podName:22283f03-b1b4-4866-91bd-f1542d68df2b nodeName:}" failed. No retries permitted until 2026-07-23 17:57:47.143751134 +0000 UTC m=+8.976442286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret") pod "global-pull-secret-syncer-mcqzn" (UID: "22283f03-b1b4-4866-91bd-f1542d68df2b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:43.144224 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:43.144200    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:43.144325 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:43.144266    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs podName:535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:47.144246468 +0000 UTC m=+8.976937617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs") pod "network-metrics-daemon-4ph55" (UID: "535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:43.244990 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:43.244952    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:43.245762 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:43.245281    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:43.245762 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:43.245303    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:43.245762 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:43.245315    2572 projected.go:196] Error preparing data for projected volume kube-api-access-hncdt for pod openshift-network-diagnostics/network-check-target-sh98p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:43.245762 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:43.245396    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt podName:77cfedf5-9699-4fc6-bf99-a79c273f966d nodeName:}" failed. No retries permitted until 2026-07-23 17:57:47.245377283 +0000 UTC m=+9.078068437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hncdt" (UniqueName: "kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt") pod "network-check-target-sh98p" (UID: "77cfedf5-9699-4fc6-bf99-a79c273f966d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:44.792858 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:44.792829    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:44.793360 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:44.792954    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:44.793360 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:44.793343    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:44.793496 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:44.793473    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:44.793563 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:44.793522    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:44.793643 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:44.793595    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:46.787179 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:46.787145    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:46.787629 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:46.787192    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:46.787629 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:46.787145    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:46.787629 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:46.787308    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:46.787629 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:46.787445    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:46.787629 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:46.787562    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:47.180367 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:47.180322    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:47.180522 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:47.180422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:47.180603 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:47.180541    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:47.180674 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:47.180620    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret podName:22283f03-b1b4-4866-91bd-f1542d68df2b nodeName:}" failed. No retries permitted until 2026-07-23 17:57:55.180598615 +0000 UTC m=+17.013289767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret") pod "global-pull-secret-syncer-mcqzn" (UID: "22283f03-b1b4-4866-91bd-f1542d68df2b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:47.180674 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:47.180541    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:47.180751 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:47.180687    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs podName:535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215 nodeName:}" failed. No retries permitted until 2026-07-23 17:57:55.180660374 +0000 UTC m=+17.013351512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs") pod "network-metrics-daemon-4ph55" (UID: "535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:47.281088 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:47.281000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:47.281269 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:47.281139    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:47.281269 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:47.281159    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:47.281269 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:47.281169    2572 projected.go:196] Error preparing data for projected volume kube-api-access-hncdt for pod openshift-network-diagnostics/network-check-target-sh98p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:47.281269 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:47.281227    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt podName:77cfedf5-9699-4fc6-bf99-a79c273f966d nodeName:}" failed. No retries permitted until 2026-07-23 17:57:55.281207305 +0000 UTC m=+17.113898452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hncdt" (UniqueName: "kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt") pod "network-check-target-sh98p" (UID: "77cfedf5-9699-4fc6-bf99-a79c273f966d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:48.788124 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:48.787574    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:48.788124 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:48.787719    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:48.788931 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:48.788899    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:48.789058 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:48.789008    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:48.789107 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:48.789072    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:48.789153 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:48.789141    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:50.786679 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:50.786632    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:50.787164 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:50.786632    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:50.787164 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:50.786645    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:50.787164 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:50.786882    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:50.787164 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:50.786938    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:50.787472 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:50.787445    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:52.786863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:52.786781    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:52.786863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:52.786817    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:52.786863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:52.786817    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:52.787369 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:52.786912    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:52.787369 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:52.787014    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:52.787369 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:52.787133    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:54.787294 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:54.787240    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:54.787294 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:54.787282    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:54.787820 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:54.787240    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:54.787820 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:54.787379    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:54.787820 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:54.787451    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:54.787820 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:54.787525    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:55.240884 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:55.240794    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:55.240884 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:55.240860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:55.241103 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:55.240995    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:55.241103 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:55.240974    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:55.241103 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:55.241062    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret podName:22283f03-b1b4-4866-91bd-f1542d68df2b nodeName:}" failed. No retries permitted until 2026-07-23 17:58:11.241042823 +0000 UTC m=+33.073733964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret") pod "global-pull-secret-syncer-mcqzn" (UID: "22283f03-b1b4-4866-91bd-f1542d68df2b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:57:55.241103 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:55.241106    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs podName:535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:11.241083044 +0000 UTC m=+33.073774194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs") pod "network-metrics-daemon-4ph55" (UID: "535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:57:55.341666 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:55.341624    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:55.341877 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:55.341824    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:57:55.341877 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:55.341847    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:57:55.341877 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:55.341859    2572 projected.go:196] Error preparing data for projected volume kube-api-access-hncdt for pod openshift-network-diagnostics/network-check-target-sh98p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:55.342023 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:55.341926    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt podName:77cfedf5-9699-4fc6-bf99-a79c273f966d nodeName:}" failed. No retries permitted until 2026-07-23 17:58:11.341906697 +0000 UTC m=+33.174597852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hncdt" (UniqueName: "kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt") pod "network-check-target-sh98p" (UID: "77cfedf5-9699-4fc6-bf99-a79c273f966d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:57:56.787356 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:56.787181    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:56.787847 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:56.787193    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:56.787847 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:56.787429    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:56.787847 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:56.787230    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:56.787847 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:56.787519    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:56.787847 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:56.787598    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:57:58.787859 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:58.787828    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:57:58.788287 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:58.787931    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:57:58.788287 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:58.787933    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:57:58.788287 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:58.788003    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:57:58.788287 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:57:58.788040    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:57:58.788287 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:57:58.788097    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:58:00.787209 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:00.787173    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:00.787635 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:00.787279    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:58:00.787635 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:00.787173    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:00.787635 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:00.787318    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:00.787635 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:00.787388    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:58:00.787635 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:00.787453    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:58:02.044017 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.043790    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr" event={"ID":"bd748a4c-0a35-426e-8352-9a3f0530edf8","Type":"ContainerStarted","Data":"cfe019deba37bb8ad2cccde0d2909dc214db056022e3d0ea795b9bb3b391ef45"}
Jul 23 17:58:02.045204 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.045174    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wqhlk" event={"ID":"abc29980-1bd1-463b-8fe7-3a6be20750c8","Type":"ContainerStarted","Data":"ea4453500c2c933447674dc6c785d6ad0344fecbe701173fb7131ca8c5713df8"}
Jul 23 17:58:02.046500 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.046480    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bqk5j" event={"ID":"b3948691-c50e-4038-bede-73ef860778db","Type":"ContainerStarted","Data":"64b1c3952f2343989fd08405eb7a73f23cb164543b6573bb4f49b9c4834ad778"}
Jul 23 17:58:02.047776 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.047736    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gxdbb" event={"ID":"6004c343-fd6c-4f9d-af11-f014ad66a2d4","Type":"ContainerStarted","Data":"2c4e213f6292bb467ab3a7a1cddc2ffdd51da6956e77c9deae3bf36087918e66"}
Jul 23 17:58:02.049175 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.049156    2572 generic.go:356] "Generic (PLEG): container finished" podID="af21b217-5075-4d30-92d1-e06c905de394" containerID="d2a3d58a746970451327beff7f62a25bc49cf2346b7ba233a4fab752fc71f150" exitCode=0
Jul 23 17:58:02.049249 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.049219    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-266bn" event={"ID":"af21b217-5075-4d30-92d1-e06c905de394","Type":"ContainerDied","Data":"d2a3d58a746970451327beff7f62a25bc49cf2346b7ba233a4fab752fc71f150"}
Jul 23 17:58:02.052453 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.052433    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"3135bf6b4855ba2c8fe546903b9b4f30d290e541cdf8a86a0d8d0f893d7d34bd"}
Jul 23 17:58:02.052543 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.052495    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"90e56ec117e30ed16957d6837b7047ae168d9946e707f73a401b77e68e178610"}
Jul 23 17:58:02.052612 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.052544    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"f09f3555ce38783a549fb99f5b504c260b413ef6a1bab68567a050f22ed390e1"}
Jul 23 17:58:02.052669 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.052615    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"d9d3c70ba5de8703d8ba5d7e9beb084bde62d3cf93aaf2ca16bc672c681b4e58"}
Jul 23 17:58:02.052669 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.052660    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"0b361097ccddf9004128feb9b6af9149e5bf19b253e03e6d61d1cb145bcf4279"}
Jul 23 17:58:02.052783 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.052693    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"a95a9c081fb68fb4d3cf085efe4c9612afacad7e575c2b413c919a6c48dea85d"}
Jul 23 17:58:02.053860 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.053837    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal" event={"ID":"be78cfb9e61c5f94e698648d53053e99","Type":"ContainerStarted","Data":"0f4dced922fa41b781e8e8ce6d31e6723623c1f85a070ed265a0ecf66ec9e51f"}
Jul 23 17:58:02.055149 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.055129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kkcjf" event={"ID":"69a29389-c968-4e40-a920-7c5caea45328","Type":"ContainerStarted","Data":"e37759e591b91e0f6a1b674137d55d8301fe47a135ca20f7198ca3dd6ec33fef"}
Jul 23 17:58:02.056455 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.056436    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j8hj9" event={"ID":"86684ec3-a9a4-4242-ae3b-1c58d91b5fdb","Type":"ContainerStarted","Data":"4d25d1591d47ebea04a6acec9cdf8d3b6a76aed82a26400a7e311dee15ced170"}
Jul 23 17:58:02.057681 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.057662    2572 generic.go:356] "Generic (PLEG): container finished" podID="000e9bb5607575f5cb60224ba858851f" containerID="6ac360d40724c0c86cf6906743818ac437298d8aa9970589247346ded0eaa92e" exitCode=0
Jul 23 17:58:02.057833 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.057689    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal" event={"ID":"000e9bb5607575f5cb60224ba858851f","Type":"ContainerDied","Data":"6ac360d40724c0c86cf6906743818ac437298d8aa9970589247346ded0eaa92e"}
Jul 23 17:58:02.069746 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.069710    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wqhlk" podStartSLOduration=2.047039905 podStartE2EDuration="23.069699602s" totalImagesPullingTime="21.022659697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:02.069130138 +0000 UTC m=+23.901821296" watchObservedRunningTime="2026-07-23 17:58:02.069699602 +0000 UTC m=+23.902390759"
Jul 23 17:58:02.113436 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.113385    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j8hj9" podStartSLOduration=1.954508723 podStartE2EDuration="23.113366666s" totalImagesPullingTime="21.158857943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:02.091062623 +0000 UTC m=+23.923753781" watchObservedRunningTime="2026-07-23 17:58:02.113366666 +0000 UTC m=+23.946057824"
Jul 23 17:58:02.145381 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.145334    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bqk5j" podStartSLOduration=10.473806306 podStartE2EDuration="23.145318136s" totalImagesPullingTime="12.67151183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:02.113916682 +0000 UTC m=+23.946607841" watchObservedRunningTime="2026-07-23 17:58:02.145318136 +0000 UTC m=+23.978009296"
Jul 23 17:58:02.198941 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.198677    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gxdbb" podStartSLOduration=2.377053467 podStartE2EDuration="23.198656861s" totalImagesPullingTime="20.821603394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:02.197877125 +0000 UTC m=+24.030568283" watchObservedRunningTime="2026-07-23 17:58:02.198656861 +0000 UTC m=+24.031348020"
Jul 23 17:58:02.265499 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.265443    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kkcjf" podStartSLOduration=2.142784598 podStartE2EDuration="23.26542359s" totalImagesPullingTime="21.122638992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:02.265138706 +0000 UTC m=+24.097829865" watchObservedRunningTime="2026-07-23 17:58:02.26542359 +0000 UTC m=+24.098114751"
Jul 23 17:58:02.265943 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.265908    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-70.ec2.internal" podStartSLOduration=22.265895976 podStartE2EDuration="22.265895976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:02.216544581 +0000 UTC m=+24.049235739" watchObservedRunningTime="2026-07-23 17:58:02.265895976 +0000 UTC m=+24.098587135"
Jul 23 17:58:02.786978 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.786941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:02.786978 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.786980    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:02.787294 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.786953    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:02.787294 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:02.787096    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:58:02.787294 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:02.787167    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:58:02.787294 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:02.787224    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:58:02.995045 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:02.995016    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 17:58:03.062830 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.062725    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr" event={"ID":"bd748a4c-0a35-426e-8352-9a3f0530edf8","Type":"ContainerStarted","Data":"156203579ee421a79cb9cf8d499a5ecc65ac6cb5ee70e66b57ef3e9090aeb286"}
Jul 23 17:58:03.064266 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.064233    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b2lbg" event={"ID":"84e0abd7-c74a-4e95-83bd-ca41a57c735a","Type":"ContainerStarted","Data":"6300f6f37947a444eb6a3b8231f79a394eb43371c275e2e84019fe51ed4d137a"}
Jul 23 17:58:03.065124 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.065106    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"
Jul 23 17:58:03.087218 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.087178    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 17:58:03.087218 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.087209    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal"]
Jul 23 17:58:03.088839 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.088796    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b2lbg" podStartSLOduration=3.238475438 podStartE2EDuration="24.088779705s" totalImagesPullingTime="20.850304267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:03.088008213 +0000 UTC m=+24.920699371" watchObservedRunningTime="2026-07-23 17:58:03.088779705 +0000 UTC m=+24.921470864"
Jul 23 17:58:03.199263 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.199234    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:58:03.199983 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.199959    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:58:03.721422 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.721312    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T17:58:02.995035251Z","UUID":"37d853a8-debc-491b-8ac3-d995c3e62a59","Handler":null,"Name":"","Endpoint":""}
Jul 23 17:58:03.723218 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.723195    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 17:58:03.723331 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:03.723242    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 17:58:04.068521 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:04.068485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal" event={"ID":"000e9bb5607575f5cb60224ba858851f","Type":"ContainerStarted","Data":"88dcb1bb9b0b617b4f26770895e44e970a8177c07aa56e62e2020bcbc9709718"}
Jul 23 17:58:04.068932 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:04.068650    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:58:04.069199 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:04.069179    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gxdbb"
Jul 23 17:58:04.089017 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:04.088968    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-70.ec2.internal" podStartSLOduration=1.088948436 podStartE2EDuration="1.088948436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:04.088528729 +0000 UTC m=+25.921219888" watchObservedRunningTime="2026-07-23 17:58:04.088948436 +0000 UTC m=+25.921639596"
Jul 23 17:58:04.787463 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:04.787431    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:04.787718 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:04.787430    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:04.787718 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:04.787551    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:58:04.787718 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:04.787437    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:04.787718 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:04.787628    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:58:04.787949 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:04.787709    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:58:05.074245 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:05.074139    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr" event={"ID":"bd748a4c-0a35-426e-8352-9a3f0530edf8","Type":"ContainerStarted","Data":"45e2de5efcb83ef478ac978541d5ad257a5244121a6c30f84f676021a7ef5413"}
Jul 23 17:58:05.077857 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:05.077819    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"fc4cde14b341e5f713222df6bf22aab1d62c852b83cd91925a4e40dc63e41f09"}
Jul 23 17:58:06.787682 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:06.787442    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:06.788314 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:06.787448    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:06.788314 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:06.787813    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:58:06.788314 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:06.787442    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:06.788314 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:06.787850    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:58:06.788314 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:06.787946    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:58:07.083291 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:07.083255    2572 generic.go:356] "Generic (PLEG): container finished" podID="af21b217-5075-4d30-92d1-e06c905de394" containerID="08874f29a61b84cd4500c5f7aac1966339104d6093554a2479501476124c7146" exitCode=0
Jul 23 17:58:07.083466 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:07.083332    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-266bn" event={"ID":"af21b217-5075-4d30-92d1-e06c905de394","Type":"ContainerDied","Data":"08874f29a61b84cd4500c5f7aac1966339104d6093554a2479501476124c7146"}
Jul 23 17:58:07.087026 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:07.086999    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" event={"ID":"bf158ea0-13be-4e89-aaed-bb5d885fc798","Type":"ContainerStarted","Data":"9400a5ee1dd04af8b7fef7d649c2748d4860141a6bdcd6fa44730689522d2d22"}
Jul 23 17:58:07.087269 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:07.087254    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:58:07.087343 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:07.087314    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:58:07.102705 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:07.102688    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:58:07.131566 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:07.131522    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn6tr" podStartSLOduration=4.913184188 podStartE2EDuration="28.131506566s" totalImagesPullingTime="23.218322378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:05.111777481 +0000 UTC m=+26.944468640" watchObservedRunningTime="2026-07-23 17:58:07.131506566 +0000 UTC m=+28.964197715"
Jul 23 17:58:07.178927 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:07.178877    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd" podStartSLOduration=6.828393206 podStartE2EDuration="28.178860821s" totalImagesPullingTime="21.350467615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:07.175445529 +0000 UTC m=+29.008136687" watchObservedRunningTime="2026-07-23 17:58:07.178860821 +0000 UTC m=+29.011551978"
Jul 23 17:58:08.090098 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:08.090072    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:58:08.104584 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:08.104562    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:58:08.687065 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:08.686872    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mcqzn"]
Jul 23 17:58:08.687247 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:08.687151    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:08.687287 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:08.687248    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:58:08.694080 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:08.694053    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4ph55"]
Jul 23 17:58:08.694233 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:08.694179    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:08.694316 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:08.694293    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:58:08.694657 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:08.694636    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sh98p"]
Jul 23 17:58:08.694768 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:08.694725    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:08.694850 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:08.694829    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:58:09.094974 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:09.093628    2572 generic.go:356] "Generic (PLEG): container finished" podID="af21b217-5075-4d30-92d1-e06c905de394" containerID="404d3138acf353885afcc73222f9ad3a0a9b1521c0f1e85f281195ada5baa3a5" exitCode=0
Jul 23 17:58:09.094974 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:09.093797    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-266bn" event={"ID":"af21b217-5075-4d30-92d1-e06c905de394","Type":"ContainerDied","Data":"404d3138acf353885afcc73222f9ad3a0a9b1521c0f1e85f281195ada5baa3a5"}
Jul 23 17:58:10.786937 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:10.786901    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:10.786937 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:10.786940    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:10.787344 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:10.787021    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:58:10.787344 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:10.787063    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:58:10.787344 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:10.787120    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:10.787344 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:10.787186    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:58:11.099617 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:11.099589    2572 generic.go:356] "Generic (PLEG): container finished" podID="af21b217-5075-4d30-92d1-e06c905de394" containerID="892efe917293d7bb38610240385728dfa0df346c8716659133f5a77f43483a83" exitCode=0
Jul 23 17:58:11.099797 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:11.099637    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-266bn" event={"ID":"af21b217-5075-4d30-92d1-e06c905de394","Type":"ContainerDied","Data":"892efe917293d7bb38610240385728dfa0df346c8716659133f5a77f43483a83"}
Jul 23 17:58:11.248396 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:11.248366    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:11.248592 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:11.248449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:11.248592 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:11.248497    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 17:58:11.248592 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:11.248542    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:58:11.248592 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:11.248558    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret podName:22283f03-b1b4-4866-91bd-f1542d68df2b nodeName:}" failed. No retries permitted until 2026-07-23 17:58:43.248537837 +0000 UTC m=+65.081228990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret") pod "global-pull-secret-syncer-mcqzn" (UID: "22283f03-b1b4-4866-91bd-f1542d68df2b") : object "kube-system"/"original-pull-secret" not registered
Jul 23 17:58:11.248592 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:11.248591    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs podName:535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:43.248576137 +0000 UTC m=+65.081267287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs") pod "network-metrics-daemon-4ph55" (UID: "535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 17:58:11.349420 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:11.349389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:11.349592 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:11.349510    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 17:58:11.349592 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:11.349525    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 17:58:11.349592 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:11.349534    2572 projected.go:196] Error preparing data for projected volume kube-api-access-hncdt for pod openshift-network-diagnostics/network-check-target-sh98p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:58:11.349592 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:11.349585    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt podName:77cfedf5-9699-4fc6-bf99-a79c273f966d nodeName:}" failed. No retries permitted until 2026-07-23 17:58:43.349572317 +0000 UTC m=+65.182263454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hncdt" (UniqueName: "kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt") pod "network-check-target-sh98p" (UID: "77cfedf5-9699-4fc6-bf99-a79c273f966d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 17:58:12.786508 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:12.786470    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:12.786983 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:12.786470    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:12.786983 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:12.786608    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ph55" podUID="535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215"
Jul 23 17:58:12.786983 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:12.786470    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:12.786983 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:12.786661    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sh98p" podUID="77cfedf5-9699-4fc6-bf99-a79c273f966d"
Jul 23 17:58:12.786983 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:12.786735    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mcqzn" podUID="22283f03-b1b4-4866-91bd-f1542d68df2b"
Jul 23 17:58:14.029266 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.029231    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-70.ec2.internal" event="NodeReady"
Jul 23 17:58:14.029722 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.029378    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 17:58:14.085418 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.084577    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-98bl8"]
Jul 23 17:58:14.089670 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.089645    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8856l"]
Jul 23 17:58:14.089823 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.089788    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.092641 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.092602    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 17:58:14.092793 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.092610    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 17:58:14.093099 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.093083    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-djwnl\""
Jul 23 17:58:14.093503 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.093485    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8856l"
Jul 23 17:58:14.096320 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.096300    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xlctx\""
Jul 23 17:58:14.096320 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.096313    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 17:58:14.096451 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.096319    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 17:58:14.096659 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.096641    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 17:58:14.099592 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.099538    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8856l"]
Jul 23 17:58:14.100352 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.100329    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98bl8"]
Jul 23 17:58:14.168661 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.168623    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26hbs\" (UniqueName: \"kubernetes.io/projected/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-kube-api-access-26hbs\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.168661 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.168662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f56ac216-1379-4af2-a1df-b4b7955ef602-cert\") pod \"ingress-canary-8856l\" (UID: \"f56ac216-1379-4af2-a1df-b4b7955ef602\") " pod="openshift-ingress-canary/ingress-canary-8856l"
Jul 23 17:58:14.168951 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.168773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.168951 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.168803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-tmp-dir\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.168951 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.168889    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26lkn\" (UniqueName: \"kubernetes.io/projected/f56ac216-1379-4af2-a1df-b4b7955ef602-kube-api-access-26lkn\") pod \"ingress-canary-8856l\" (UID: \"f56ac216-1379-4af2-a1df-b4b7955ef602\") " pod="openshift-ingress-canary/ingress-canary-8856l"
Jul 23 17:58:14.169097 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.168995    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-config-volume\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.269787 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.269540    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26hbs\" (UniqueName: \"kubernetes.io/projected/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-kube-api-access-26hbs\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.269960 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.269812    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f56ac216-1379-4af2-a1df-b4b7955ef602-cert\") pod \"ingress-canary-8856l\" (UID: \"f56ac216-1379-4af2-a1df-b4b7955ef602\") " pod="openshift-ingress-canary/ingress-canary-8856l"
Jul 23 17:58:14.269960 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.269877    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.269960 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.269905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-tmp-dir\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.269960 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.269945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26lkn\" (UniqueName: \"kubernetes.io/projected/f56ac216-1379-4af2-a1df-b4b7955ef602-kube-api-access-26lkn\") pod \"ingress-canary-8856l\" (UID: \"f56ac216-1379-4af2-a1df-b4b7955ef602\") " pod="openshift-ingress-canary/ingress-canary-8856l"
Jul 23 17:58:14.270164 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.269982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-config-volume\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.270164 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:14.270009    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:14.270164 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:14.270069    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls podName:e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c nodeName:}" failed. No retries permitted until 2026-07-23 17:58:14.770051385 +0000 UTC m=+36.602742534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls") pod "dns-default-98bl8" (UID: "e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:14.270548 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.270517    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-tmp-dir\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.270809 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.270787    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-config-volume\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.275137 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.275107    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f56ac216-1379-4af2-a1df-b4b7955ef602-cert\") pod \"ingress-canary-8856l\" (UID: \"f56ac216-1379-4af2-a1df-b4b7955ef602\") " pod="openshift-ingress-canary/ingress-canary-8856l"
Jul 23 17:58:14.280289 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.280207    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26lkn\" (UniqueName: \"kubernetes.io/projected/f56ac216-1379-4af2-a1df-b4b7955ef602-kube-api-access-26lkn\") pod \"ingress-canary-8856l\" (UID: \"f56ac216-1379-4af2-a1df-b4b7955ef602\") " pod="openshift-ingress-canary/ingress-canary-8856l"
Jul 23 17:58:14.280675 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.280652    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26hbs\" (UniqueName: \"kubernetes.io/projected/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-kube-api-access-26hbs\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.409270 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.409224    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8856l"
Jul 23 17:58:14.775663 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.775625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:14.775855 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:14.775812    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:14.775909 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:14.775880    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls podName:e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c nodeName:}" failed. No retries permitted until 2026-07-23 17:58:15.775862525 +0000 UTC m=+37.608553661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls") pod "dns-default-98bl8" (UID: "e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:14.787363 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.787339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:14.787500 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.787339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:14.787557 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.787339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:14.791126 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.791102    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 17:58:14.791612 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.791590    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 17:58:14.792575 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.792365    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdhp\""
Jul 23 17:58:14.792575 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.792386    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qd4dg\""
Jul 23 17:58:14.792575 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.792400    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 17:58:14.792575 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:14.792415    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 17:58:15.226838 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:15.226653    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8856l"]
Jul 23 17:58:15.229800 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:58:15.229779    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56ac216_1379_4af2_a1df_b4b7955ef602.slice/crio-e0471d058918061c043f0928373f7ee4423838e22c9411fbaa1f2af50eb2e02a WatchSource:0}: Error finding container e0471d058918061c043f0928373f7ee4423838e22c9411fbaa1f2af50eb2e02a: Status 404 returned error can't find the container with id e0471d058918061c043f0928373f7ee4423838e22c9411fbaa1f2af50eb2e02a
Jul 23 17:58:15.781720 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:15.781683    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:15.781930 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:15.781862    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:15.781992 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:15.781938    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls podName:e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c nodeName:}" failed. No retries permitted until 2026-07-23 17:58:17.7819179 +0000 UTC m=+39.614609042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls") pod "dns-default-98bl8" (UID: "e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:16.113107 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:16.113015    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8856l" event={"ID":"f56ac216-1379-4af2-a1df-b4b7955ef602","Type":"ContainerStarted","Data":"e0471d058918061c043f0928373f7ee4423838e22c9411fbaa1f2af50eb2e02a"}
Jul 23 17:58:16.116044 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:16.116016    2572 generic.go:356] "Generic (PLEG): container finished" podID="af21b217-5075-4d30-92d1-e06c905de394" containerID="6d8f79b272ec07d7495d0e650a9ecc57965e1f6d6490173cd91ae8c320a79bad" exitCode=0
Jul 23 17:58:16.116179 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:16.116067    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-266bn" event={"ID":"af21b217-5075-4d30-92d1-e06c905de394","Type":"ContainerDied","Data":"6d8f79b272ec07d7495d0e650a9ecc57965e1f6d6490173cd91ae8c320a79bad"}
Jul 23 17:58:17.122827 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:17.122606    2572 generic.go:356] "Generic (PLEG): container finished" podID="af21b217-5075-4d30-92d1-e06c905de394" containerID="a21d6586aa44398602b7f55f444c373b1f79ef02a9d9f52e387968fa5af415ce" exitCode=0
Jul 23 17:58:17.122827 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:17.122672    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-266bn" event={"ID":"af21b217-5075-4d30-92d1-e06c905de394","Type":"ContainerDied","Data":"a21d6586aa44398602b7f55f444c373b1f79ef02a9d9f52e387968fa5af415ce"}
Jul 23 17:58:17.798092 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:17.798056    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:17.798261 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:17.798168    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:17.798261 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:17.798232    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls podName:e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c nodeName:}" failed. No retries permitted until 2026-07-23 17:58:21.798215685 +0000 UTC m=+43.630906822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls") pod "dns-default-98bl8" (UID: "e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:18.126826 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:18.126788    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8856l" event={"ID":"f56ac216-1379-4af2-a1df-b4b7955ef602","Type":"ContainerStarted","Data":"beb20bed1b6b424c0572a4e691ca0fc401d41c07e9495237710053795b600966"}
Jul 23 17:58:18.129930 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:18.129904    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-266bn" event={"ID":"af21b217-5075-4d30-92d1-e06c905de394","Type":"ContainerStarted","Data":"bee1d9a95c3db49aec72edbe73231b94c4a16a76adc16dd45e181b10ba8c25b3"}
Jul 23 17:58:18.151813 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:18.151769    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8856l" podStartSLOduration=1.69884214 podStartE2EDuration="4.151739271s" totalImagesPullingTime="2.452897131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:18.151062433 +0000 UTC m=+39.983753582" watchObservedRunningTime="2026-07-23 17:58:18.151739271 +0000 UTC m=+39.984430453"
Jul 23 17:58:18.189566 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:18.189520    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-266bn" podStartSLOduration=7.869969994 podStartE2EDuration="39.18950389s" totalImagesPullingTime="31.319533896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:18.189429234 +0000 UTC m=+40.022120392" watchObservedRunningTime="2026-07-23 17:58:18.18950389 +0000 UTC m=+40.022195049"
Jul 23 17:58:21.823934 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:21.823892    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:21.824357 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:21.824035    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:21.824357 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:21.824101    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls podName:e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c nodeName:}" failed. No retries permitted until 2026-07-23 17:58:29.824083675 +0000 UTC m=+51.656774811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls") pod "dns-default-98bl8" (UID: "e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:29.876797 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:29.876761    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:29.877286 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:29.876845    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:29.877286 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:29.876917    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls podName:e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c nodeName:}" failed. No retries permitted until 2026-07-23 17:58:45.87690086 +0000 UTC m=+67.709591996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls") pod "dns-default-98bl8" (UID: "e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:40.112661 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:40.112633    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8wgd"
Jul 23 17:58:41.793389 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.793338    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"]
Jul 23 17:58:41.796650 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.796634    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:41.802167 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.802143    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 17:58:41.802167 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.802163    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 17:58:41.802345 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.802191    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 17:58:41.802345 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.802203    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 17:58:41.802345 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.802150    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zw75q\""
Jul 23 17:58:41.804917 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.804887    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"]
Jul 23 17:58:41.806999 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.806981    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54ddffc497-95dzd"]
Jul 23 17:58:41.807122 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.807101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:41.809110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.809090    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-j8wfq"]
Jul 23 17:58:41.809200 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.809147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.811194 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.810381    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 17:58:41.811194 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.810414    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 17:58:41.811194 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.811029    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 17:58:41.811676 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.811659    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 17:58:41.812044 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.812028    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 17:58:41.812199 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.812177    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9j8p7\""
Jul 23 17:58:41.812300 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.812115    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lk5rs\""
Jul 23 17:58:41.812427 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.812404    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 17:58:41.812516 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.812490    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 17:58:41.814168 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.813673    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:41.816102 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.816077    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"]
Jul 23 17:58:41.816790 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.816769    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4bf28\""
Jul 23 17:58:41.817435 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.817418    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 17:58:41.817527 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.817508    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 17:58:41.817701 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.817643    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 17:58:41.819044 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.819023    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 17:58:41.820679 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.820660    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 17:58:41.820969 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.820953    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"]
Jul 23 17:58:41.835298 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.835280    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 17:58:41.835381 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.835315    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-j8wfq"]
Jul 23 17:58:41.835949 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.835932    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54ddffc497-95dzd"]
Jul 23 17:58:41.961280 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961254    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-config\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:41.961280 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqjmk\" (UniqueName: \"kubernetes.io/projected/9d8a3ee6-8122-4e53-b466-41d3775ec235-kube-api-access-gqjmk\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:41.961458 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961311    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.961458 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlsgp\" (UniqueName: \"kubernetes.io/projected/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-kube-api-access-wlsgp\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:41.961458 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961387    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lp89\" (UniqueName: \"kubernetes.io/projected/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-kube-api-access-5lp89\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:41.961458 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961435    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-ca-trust-extracted\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.961598 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961463    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-trusted-ca\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.961598 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bc49\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-kube-api-access-9bc49\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.961598 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961504    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-certificates\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.961598 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961539    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-image-registry-private-configuration\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.961598 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961555    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-installation-pull-secrets\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.961598 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:41.961598 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961594    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:41.961918 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961609    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d8a3ee6-8122-4e53-b466-41d3775ec235-serving-cert\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:41.961918 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:41.961918 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-bound-sa-token\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:41.961918 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d8a3ee6-8122-4e53-b466-41d3775ec235-snapshots\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:41.961918 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961722    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d8a3ee6-8122-4e53-b466-41d3775ec235-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:41.961918 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961783    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d8a3ee6-8122-4e53-b466-41d3775ec235-service-ca-bundle\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:41.961918 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:41.961816    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d8a3ee6-8122-4e53-b466-41d3775ec235-tmp\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.062792 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062689    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlsgp\" (UniqueName: \"kubernetes.io/projected/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-kube-api-access-wlsgp\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:42.062792 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lp89\" (UniqueName: \"kubernetes.io/projected/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-kube-api-access-5lp89\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:42.062792 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062739    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-ca-trust-extracted\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.062792 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-trusted-ca\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.063061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062796    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bc49\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-kube-api-access-9bc49\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.063061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062824    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-certificates\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.063061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-image-registry-private-configuration\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.063061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-installation-pull-secrets\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.063061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.062926    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:42.063061 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.063022    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:42.063061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:42.063382 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.063110    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls podName:d43c0b9e-9e41-44ea-adc1-342ba12f3ef8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:42.56308546 +0000 UTC m=+64.395776610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s479d" (UID: "d43c0b9e-9e41-44ea-adc1-342ba12f3ef8") : secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:42.063382 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d8a3ee6-8122-4e53-b466-41d3775ec235-serving-cert\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.063382 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:42.063382 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-bound-sa-token\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.063577 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063391    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d8a3ee6-8122-4e53-b466-41d3775ec235-snapshots\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.063577 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063425    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d8a3ee6-8122-4e53-b466-41d3775ec235-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.063577 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d8a3ee6-8122-4e53-b466-41d3775ec235-service-ca-bundle\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.063577 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063514    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d8a3ee6-8122-4e53-b466-41d3775ec235-tmp\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.063577 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063564    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-ca-trust-extracted\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.063829 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.063566    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-certificates\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.064194 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.064169    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d8a3ee6-8122-4e53-b466-41d3775ec235-snapshots\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.064601 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.064582    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-trusted-ca\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.064881 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.064849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d8a3ee6-8122-4e53-b466-41d3775ec235-tmp\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.064969 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.064949    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:42.065038 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.064973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-config\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:42.065099 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.065037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqjmk\" (UniqueName: \"kubernetes.io/projected/9d8a3ee6-8122-4e53-b466-41d3775ec235-kube-api-access-gqjmk\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.065154 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.065099    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.065235 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.065207    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:58:42.065235 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.065207    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d8a3ee6-8122-4e53-b466-41d3775ec235-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.065235 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.065220    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54ddffc497-95dzd: secret "image-registry-tls" not found
Jul 23 17:58:42.065435 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.065263    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls podName:7ca3f3ad-7957-42e3-98b9-93f405e9c8c4 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:42.565247891 +0000 UTC m=+64.397939027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls") pod "image-registry-54ddffc497-95dzd" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4") : secret "image-registry-tls" not found
Jul 23 17:58:42.065435 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.065287    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d8a3ee6-8122-4e53-b466-41d3775ec235-service-ca-bundle\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.065553 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.065484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-config\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:42.066896 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.066873    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d8a3ee6-8122-4e53-b466-41d3775ec235-serving-cert\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.066988 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.066944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-installation-pull-secrets\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.067115 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.067092    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:42.067272 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.067254    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-image-registry-private-configuration\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.072321 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.072266    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lp89\" (UniqueName: \"kubernetes.io/projected/2dd9b948-a4de-4bcf-ba1b-28b0f189c20a-kube-api-access-5lp89\") pod \"service-ca-operator-5bcbc94c78-xpw5b\" (UID: \"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:42.072446 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.072387    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlsgp\" (UniqueName: \"kubernetes.io/projected/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-kube-api-access-wlsgp\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:42.072446 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.072407    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bc49\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-kube-api-access-9bc49\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.073138 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.073116    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-bound-sa-token\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.073625 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.073609    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqjmk\" (UniqueName: \"kubernetes.io/projected/9d8a3ee6-8122-4e53-b466-41d3775ec235-kube-api-access-gqjmk\") pod \"insights-operator-555d9d7885-j8wfq\" (UID: \"9d8a3ee6-8122-4e53-b466-41d3775ec235\") " pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.119447 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.119427    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"
Jul 23 17:58:42.130954 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.130932    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-j8wfq"
Jul 23 17:58:42.265351 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.265321    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b"]
Jul 23 17:58:42.268843 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:58:42.268816    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd9b948_a4de_4bcf_ba1b_28b0f189c20a.slice/crio-7a1db7ef21207f4915787075998aef7aeba8f7b836cc88918c6bea14d0215a3a WatchSource:0}: Error finding container 7a1db7ef21207f4915787075998aef7aeba8f7b836cc88918c6bea14d0215a3a: Status 404 returned error can't find the container with id 7a1db7ef21207f4915787075998aef7aeba8f7b836cc88918c6bea14d0215a3a
Jul 23 17:58:42.282012 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.281981    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-j8wfq"]
Jul 23 17:58:42.284822 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:58:42.284801    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d8a3ee6_8122_4e53_b466_41d3775ec235.slice/crio-d54f80c5831e21bc5fdd5a066762f908e76b9e80e4bd702b93ff75f6ad0bb428 WatchSource:0}: Error finding container d54f80c5831e21bc5fdd5a066762f908e76b9e80e4bd702b93ff75f6ad0bb428: Status 404 returned error can't find the container with id d54f80c5831e21bc5fdd5a066762f908e76b9e80e4bd702b93ff75f6ad0bb428
Jul 23 17:58:42.569007 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.568979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:42.569164 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:42.569082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:42.569164 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.569134    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:42.569231 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.569173    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:58:42.569231 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.569187    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54ddffc497-95dzd: secret "image-registry-tls" not found
Jul 23 17:58:42.569231 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.569204    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls podName:d43c0b9e-9e41-44ea-adc1-342ba12f3ef8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:43.569183061 +0000 UTC m=+65.401874200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s479d" (UID: "d43c0b9e-9e41-44ea-adc1-342ba12f3ef8") : secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:42.569231 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:42.569221    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls podName:7ca3f3ad-7957-42e3-98b9-93f405e9c8c4 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:43.569210451 +0000 UTC m=+65.401901587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls") pod "image-registry-54ddffc497-95dzd" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4") : secret "image-registry-tls" not found
Jul 23 17:58:43.190238 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.190196    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-j8wfq" event={"ID":"9d8a3ee6-8122-4e53-b466-41d3775ec235","Type":"ContainerStarted","Data":"d54f80c5831e21bc5fdd5a066762f908e76b9e80e4bd702b93ff75f6ad0bb428"}
Jul 23 17:58:43.191502 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.191476    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b" event={"ID":"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a","Type":"ContainerStarted","Data":"7a1db7ef21207f4915787075998aef7aeba8f7b836cc88918c6bea14d0215a3a"}
Jul 23 17:58:43.274136 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.274100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:58:43.274306 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.274160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:43.277088 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.277062    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 17:58:43.277736 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.277710    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 17:58:43.284392 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:43.284370    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 17:58:43.284504 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:43.284437    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs podName:535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215 nodeName:}" failed. No retries permitted until 2026-07-23 17:59:47.284415775 +0000 UTC m=+129.117106912 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs") pod "network-metrics-daemon-4ph55" (UID: "535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215") : secret "metrics-daemon-secret" not found
Jul 23 17:58:43.286746 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.286723    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22283f03-b1b4-4866-91bd-f1542d68df2b-original-pull-secret\") pod \"global-pull-secret-syncer-mcqzn\" (UID: \"22283f03-b1b4-4866-91bd-f1542d68df2b\") " pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:43.298787 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.298765    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mcqzn"
Jul 23 17:58:43.374987 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.374956    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:43.378195 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.378166    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 17:58:43.389667 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.389619    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 17:58:43.399687 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.399627    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hncdt\" (UniqueName: \"kubernetes.io/projected/77cfedf5-9699-4fc6-bf99-a79c273f966d-kube-api-access-hncdt\") pod \"network-check-target-sh98p\" (UID: \"77cfedf5-9699-4fc6-bf99-a79c273f966d\") " pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:43.456569 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.456492    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mcqzn"]
Jul 23 17:58:43.461610 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:58:43.461569    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22283f03_b1b4_4866_91bd_f1542d68df2b.slice/crio-74798b570d03b22e6e171099aae174466708f6ae69e28840459f35bf8f9939f9 WatchSource:0}: Error finding container 74798b570d03b22e6e171099aae174466708f6ae69e28840459f35bf8f9939f9: Status 404 returned error can't find the container with id 74798b570d03b22e6e171099aae174466708f6ae69e28840459f35bf8f9939f9
Jul 23 17:58:43.577830 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.577788    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:43.577968 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.577908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:43.578014 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:43.577963    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:43.578057 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:43.578040    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:58:43.578057 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:43.578053    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls podName:d43c0b9e-9e41-44ea-adc1-342ba12f3ef8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:45.578030563 +0000 UTC m=+67.410721702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s479d" (UID: "d43c0b9e-9e41-44ea-adc1-342ba12f3ef8") : secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:43.578129 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:43.578054    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54ddffc497-95dzd: secret "image-registry-tls" not found
Jul 23 17:58:43.578129 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:43.578094    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls podName:7ca3f3ad-7957-42e3-98b9-93f405e9c8c4 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:45.578084018 +0000 UTC m=+67.410775158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls") pod "image-registry-54ddffc497-95dzd" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4") : secret "image-registry-tls" not found
Jul 23 17:58:43.615092 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.615063    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qd4dg\""
Jul 23 17:58:43.621156 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.621139    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:43.761259 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:43.761223    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sh98p"]
Jul 23 17:58:43.765328 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:58:43.765298    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77cfedf5_9699_4fc6_bf99_a79c273f966d.slice/crio-406b246ae6bb7ecf252aecb237f59ddcb2067944cb004cf613f5ef995234fa4f WatchSource:0}: Error finding container 406b246ae6bb7ecf252aecb237f59ddcb2067944cb004cf613f5ef995234fa4f: Status 404 returned error can't find the container with id 406b246ae6bb7ecf252aecb237f59ddcb2067944cb004cf613f5ef995234fa4f
Jul 23 17:58:44.196209 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:44.196123    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sh98p" event={"ID":"77cfedf5-9699-4fc6-bf99-a79c273f966d","Type":"ContainerStarted","Data":"406b246ae6bb7ecf252aecb237f59ddcb2067944cb004cf613f5ef995234fa4f"}
Jul 23 17:58:44.198129 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:44.198101    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mcqzn" event={"ID":"22283f03-b1b4-4866-91bd-f1542d68df2b","Type":"ContainerStarted","Data":"74798b570d03b22e6e171099aae174466708f6ae69e28840459f35bf8f9939f9"}
Jul 23 17:58:45.595025 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:45.594177    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:45.595025 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:45.594282    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:45.595025 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:45.594417    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:58:45.595025 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:45.594433    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54ddffc497-95dzd: secret "image-registry-tls" not found
Jul 23 17:58:45.595025 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:45.594487    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls podName:7ca3f3ad-7957-42e3-98b9-93f405e9c8c4 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:49.594469308 +0000 UTC m=+71.427160448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls") pod "image-registry-54ddffc497-95dzd" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4") : secret "image-registry-tls" not found
Jul 23 17:58:45.595025 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:45.594900    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:45.595025 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:45.594952    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls podName:d43c0b9e-9e41-44ea-adc1-342ba12f3ef8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:49.594935566 +0000 UTC m=+71.427626708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s479d" (UID: "d43c0b9e-9e41-44ea-adc1-342ba12f3ef8") : secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:45.896916 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:45.896821    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:58:45.897086 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:45.896989    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 17:58:45.897086 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:45.897052    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls podName:e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c nodeName:}" failed. No retries permitted until 2026-07-23 17:59:17.897033205 +0000 UTC m=+99.729724343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls") pod "dns-default-98bl8" (UID: "e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c") : secret "dns-default-metrics-tls" not found
Jul 23 17:58:46.206821 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:46.206264    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b" event={"ID":"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a","Type":"ContainerStarted","Data":"f83ec4efdc20ed0b4d261fc73b17013f9ec1adaef4e14df471bc361a4a4c412d"}
Jul 23 17:58:46.208846 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:46.208746    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-j8wfq" event={"ID":"9d8a3ee6-8122-4e53-b466-41d3775ec235","Type":"ContainerStarted","Data":"45496a17a3bb5cb538309b4eca3591a94910002eabaf6b236332fd58521d9936"}
Jul 23 17:58:46.237185 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:46.237112    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b" podStartSLOduration=2.15827016 podStartE2EDuration="5.237090889s" totalImagesPullingTime="3.078820729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:46.234862709 +0000 UTC m=+68.067553867" watchObservedRunningTime="2026-07-23 17:58:46.237090889 +0000 UTC m=+68.069782048"
Jul 23 17:58:46.271709 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:46.271650    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-j8wfq" podStartSLOduration=2.213406449 podStartE2EDuration="5.27163024s" totalImagesPullingTime="3.058223791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:46.270301414 +0000 UTC m=+68.102992574" watchObservedRunningTime="2026-07-23 17:58:46.27163024 +0000 UTC m=+68.104321398"
Jul 23 17:58:47.530155 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.530125    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nfps8"]
Jul 23 17:58:47.545785 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.545745    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.549892 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.549823    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nfps8"]
Jul 23 17:58:47.551721 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.551698    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 17:58:47.551863 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.551730    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dj9xd\""
Jul 23 17:58:47.552209 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.552184    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 17:58:47.611806 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.611746    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4faaf47a-401c-4b15-b098-077b2dc474ab-data-volume\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.611979 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.611888    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx8g8\" (UniqueName: \"kubernetes.io/projected/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-api-access-jx8g8\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.611979 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.611937    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.611979 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.611973    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4faaf47a-401c-4b15-b098-077b2dc474ab-crio-socket\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.612127 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.612001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.712647 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.712610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4faaf47a-401c-4b15-b098-077b2dc474ab-data-volume\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.712832 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.712697    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx8g8\" (UniqueName: \"kubernetes.io/projected/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-api-access-jx8g8\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.712832 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.712737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.712832 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.712789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4faaf47a-401c-4b15-b098-077b2dc474ab-crio-socket\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.712832 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.712817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.713046 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:47.712915    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:47.713046 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:47.712998    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:47.713257 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.712993    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4faaf47a-401c-4b15-b098-077b2dc474ab-data-volume\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.713257 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:47.713000    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:58:48.212975437 +0000 UTC m=+70.045666592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:47.713257 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.713086    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4faaf47a-401c-4b15-b098-077b2dc474ab-crio-socket\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:47.713257 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:47.713095    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:58:48.213078169 +0000 UTC m=+70.045769311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:47.750011 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:47.749976    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx8g8\" (UniqueName: \"kubernetes.io/projected/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-api-access-jx8g8\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:48.216644 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:48.216613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:48.216855 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:48.216663    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:48.216855 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:48.216737    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:48.216978 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:48.216855    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:48.216978 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:48.216854    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:58:49.216831185 +0000 UTC m=+71.049522528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:48.216978 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:48.216958    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:58:49.216930909 +0000 UTC m=+71.049622059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:49.224529 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:49.224501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:49.224907 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:49.224537    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:49.224907 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.224615    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:49.224907 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.224653    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:49.224907 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.224681    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:58:51.22466326 +0000 UTC m=+73.057354412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:49.224907 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.224697    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:58:51.224689776 +0000 UTC m=+73.057380912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:49.627972 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:49.627938    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:49.628110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:49.627977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:49.628110 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.628084    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:49.628190 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.628131    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls podName:d43c0b9e-9e41-44ea-adc1-342ba12f3ef8 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:57.62811759 +0000 UTC m=+79.460808726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s479d" (UID: "d43c0b9e-9e41-44ea-adc1-342ba12f3ef8") : secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:49.628190 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.628084    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 17:58:49.628190 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.628171    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54ddffc497-95dzd: secret "image-registry-tls" not found
Jul 23 17:58:49.628287 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:49.628215    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls podName:7ca3f3ad-7957-42e3-98b9-93f405e9c8c4 nodeName:}" failed. No retries permitted until 2026-07-23 17:58:57.628201512 +0000 UTC m=+79.460892651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls") pod "image-registry-54ddffc497-95dzd" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4") : secret "image-registry-tls" not found
Jul 23 17:58:50.220689 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:50.220654    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sh98p" event={"ID":"77cfedf5-9699-4fc6-bf99-a79c273f966d","Type":"ContainerStarted","Data":"2e628957de3c65a00e2086d868b3d3e47f930f27f5d616582285f7d423c7384f"}
Jul 23 17:58:50.220903 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:50.220849    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:58:50.221976 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:50.221954    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mcqzn" event={"ID":"22283f03-b1b4-4866-91bd-f1542d68df2b","Type":"ContainerStarted","Data":"5be9180884f98046931c6a7ef48ff7a0abcde273f51745d0e70a05fd015e2300"}
Jul 23 17:58:50.253120 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:50.253079    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sh98p" podStartSLOduration=65.769121771 podStartE2EDuration="1m11.253067463s" totalImagesPullingTime="5.483945692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:50.252157759 +0000 UTC m=+72.084848918" watchObservedRunningTime="2026-07-23 17:58:50.253067463 +0000 UTC m=+72.085758620"
Jul 23 17:58:50.282513 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:50.282478    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mcqzn" podStartSLOduration=65.494531081 podStartE2EDuration="1m11.282467793s" totalImagesPullingTime="5.787936712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:50.282375642 +0000 UTC m=+72.115066801" watchObservedRunningTime="2026-07-23 17:58:50.282467793 +0000 UTC m=+72.115158951"
Jul 23 17:58:50.444145 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:50.444121    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wqhlk_abc29980-1bd1-463b-8fe7-3a6be20750c8/dns-node-resolver/0.log"
Jul 23 17:58:51.045255 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:51.045228    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bqk5j_b3948691-c50e-4038-bede-73ef860778db/node-ca/0.log"
Jul 23 17:58:51.239929 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:51.239898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:51.240100 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:51.239939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:51.240100 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:51.240017    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:51.240100 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:51.240086    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:58:55.240068663 +0000 UTC m=+77.072759802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:51.240208 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:51.240106    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:51.240208 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:51.240151    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:58:55.240135596 +0000 UTC m=+77.072826785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:51.843765 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:51.843694    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8856l_f56ac216-1379-4af2-a1df-b4b7955ef602/serve-healthcheck-canary/0.log"
Jul 23 17:58:55.270798 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:55.270762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:55.271168 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:55.270809    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:58:55.271168 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:55.270864    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 17:58:55.271168 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:55.270929    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:59:03.27091287 +0000 UTC m=+85.103604008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : configmap "kube-rbac-proxy" not found
Jul 23 17:58:55.271168 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:55.270956    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:55.271168 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:55.271018    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls podName:4faaf47a-401c-4b15-b098-077b2dc474ab nodeName:}" failed. No retries permitted until 2026-07-23 17:59:03.271004463 +0000 UTC m=+85.103695599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nfps8" (UID: "4faaf47a-401c-4b15-b098-077b2dc474ab") : secret "insights-runtime-extractor-tls" not found
Jul 23 17:58:57.688820 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:57.688773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:57.689292 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:57.688835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:58:57.689292 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:57.688958    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:57.689292 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:58:57.689043    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls podName:d43c0b9e-9e41-44ea-adc1-342ba12f3ef8 nodeName:}" failed. No retries permitted until 2026-07-23 17:59:13.689023256 +0000 UTC m=+95.521714404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-s479d" (UID: "d43c0b9e-9e41-44ea-adc1-342ba12f3ef8") : secret "cluster-monitoring-operator-tls" not found
Jul 23 17:58:57.691130 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:57.691111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"image-registry-54ddffc497-95dzd\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") " pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:57.726477 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:57.726453    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:57.864538 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:57.864498    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54ddffc497-95dzd"]
Jul 23 17:58:57.867612 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:58:57.867586    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca3f3ad_7957_42e3_98b9_93f405e9c8c4.slice/crio-2983ecb3331806a83708c2433d3ba82149f6eee3d935913a4a985c7592b028e0 WatchSource:0}: Error finding container 2983ecb3331806a83708c2433d3ba82149f6eee3d935913a4a985c7592b028e0: Status 404 returned error can't find the container with id 2983ecb3331806a83708c2433d3ba82149f6eee3d935913a4a985c7592b028e0
Jul 23 17:58:58.245820 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:58.245783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54ddffc497-95dzd" event={"ID":"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4","Type":"ContainerStarted","Data":"86275a6ec249b2cb1656b6bb68e1dc3c9139c13da4a84d601ee79861c24f3f4e"}
Jul 23 17:58:58.245997 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:58.245838    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54ddffc497-95dzd" event={"ID":"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4","Type":"ContainerStarted","Data":"2983ecb3331806a83708c2433d3ba82149f6eee3d935913a4a985c7592b028e0"}
Jul 23 17:58:58.245997 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:58.245968    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:58:58.271474 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:58:58.271429    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54ddffc497-95dzd" podStartSLOduration=17.271414456 podStartE2EDuration="17.271414456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:58:58.271162616 +0000 UTC m=+80.103853796" watchObservedRunningTime="2026-07-23 17:58:58.271414456 +0000 UTC m=+80.104105613"
Jul 23 17:59:03.333188 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:03.333061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:59:03.333188 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:03.333107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:59:03.333653 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:03.333564    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4faaf47a-401c-4b15-b098-077b2dc474ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:59:03.335342 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:03.335324    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4faaf47a-401c-4b15-b098-077b2dc474ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nfps8\" (UID: \"4faaf47a-401c-4b15-b098-077b2dc474ab\") " pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:59:03.458745 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:03.458704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nfps8"
Jul 23 17:59:03.589623 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:03.589547    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nfps8"]
Jul 23 17:59:03.592696 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:59:03.592670    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4faaf47a_401c_4b15_b098_077b2dc474ab.slice/crio-4768dd5597e433ae4d14cacbd472edeeb7a973ff293989b28c34a8de24be7184 WatchSource:0}: Error finding container 4768dd5597e433ae4d14cacbd472edeeb7a973ff293989b28c34a8de24be7184: Status 404 returned error can't find the container with id 4768dd5597e433ae4d14cacbd472edeeb7a973ff293989b28c34a8de24be7184
Jul 23 17:59:04.269723 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:04.269681    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nfps8" event={"ID":"4faaf47a-401c-4b15-b098-077b2dc474ab","Type":"ContainerStarted","Data":"4768dd5597e433ae4d14cacbd472edeeb7a973ff293989b28c34a8de24be7184"}
Jul 23 17:59:09.289336 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:09.289257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nfps8" event={"ID":"4faaf47a-401c-4b15-b098-077b2dc474ab","Type":"ContainerStarted","Data":"9789abc44b6a9f2d62d75f639b6bf15cfb89b01b49361f3e76f0fb97d1ffd208"}
Jul 23 17:59:12.110330 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.110293    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"]
Jul 23 17:59:12.113405 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.113389    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.123933 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.123900    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 17:59:12.124408 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.124390    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 17:59:12.125006 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.124935    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 17:59:12.125006 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.124979    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 17:59:12.125704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.124982    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 17:59:12.125704 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.125246    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 17:59:12.125704 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:59:12.125430    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret"
Jul 23 17:59:12.173388 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.173356    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"]
Jul 23 17:59:12.206511 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.206422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.206511 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.206469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cktl8\" (UniqueName: \"kubernetes.io/projected/b0482d1f-b722-4c45-8d62-9f731187c0c3-kube-api-access-cktl8\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.206724 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.206557    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.206724 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.206610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-ca\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.206724 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.206696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0482d1f-b722-4c45-8d62-9f731187c0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.206856 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.206777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.207361 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.207345    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54ddffc497-95dzd"]
Jul 23 17:59:12.211779 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.211740    2572 patch_prober.go:28] interesting pod/image-registry-54ddffc497-95dzd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 17:59:12.211926 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.211808    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54ddffc497-95dzd" podUID="7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 17:59:12.300731 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.300698    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nfps8" event={"ID":"4faaf47a-401c-4b15-b098-077b2dc474ab","Type":"ContainerStarted","Data":"f2b580ae9efa4f0056599525bcaa226b3e994175e1da500a99c5e81e5e3f6281"}
Jul 23 17:59:12.308090 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.308069    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.308160 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.308095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cktl8\" (UniqueName: \"kubernetes.io/projected/b0482d1f-b722-4c45-8d62-9f731187c0c3-kube-api-access-cktl8\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.308160 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.308115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.308160 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.308135    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-ca\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.308309 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.308182    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0482d1f-b722-4c45-8d62-9f731187c0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.308364 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.308326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.308917 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.308896    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0482d1f-b722-4c45-8d62-9f731187c0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.310587 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.310561    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-ca\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.310668 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.310651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.310797 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.310781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:12.344977 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:12.344951    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cktl8\" (UniqueName: \"kubernetes.io/projected/b0482d1f-b722-4c45-8d62-9f731187c0c3-kube-api-access-cktl8\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:13.309192 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:59:13.309161    2572 secret.go:189] Couldn't get secret open-cluster-management-agent-addon/cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert: failed to sync secret cache: timed out waiting for the condition
Jul 23 17:59:13.309603 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:59:13.309238    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub podName:b0482d1f-b722-4c45-8d62-9f731187c0c3 nodeName:}" failed. No retries permitted until 2026-07-23 17:59:13.809222361 +0000 UTC m=+95.641913503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "hub" (UniqueName: "kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub") pod "cluster-proxy-proxy-agent-89b86dcc9-5tg9r" (UID: "b0482d1f-b722-4c45-8d62-9f731187c0c3") : failed to sync secret cache: timed out waiting for the condition
Jul 23 17:59:13.607978 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:13.607897    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 17:59:13.720183 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:13.720147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:59:13.723051 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:13.723022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d43c0b9e-9e41-44ea-adc1-342ba12f3ef8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-s479d\" (UID: \"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:59:13.821297 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:13.821253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:13.824095 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:13.824070    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0482d1f-b722-4c45-8d62-9f731187c0c3-hub\") pod \"cluster-proxy-proxy-agent-89b86dcc9-5tg9r\" (UID: \"b0482d1f-b722-4c45-8d62-9f731187c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:13.906103 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:13.906020    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"
Jul 23 17:59:13.929967 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:13.929937    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"
Jul 23 17:59:14.034107 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:14.034082    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d"]
Jul 23 17:59:15.844771 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:59:15.844723    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43c0b9e_9e41_44ea_adc1_342ba12f3ef8.slice/crio-1719cafbeb78511b9834852800dddabe50e4501cbb91cdb0292282a6a14aa666 WatchSource:0}: Error finding container 1719cafbeb78511b9834852800dddabe50e4501cbb91cdb0292282a6a14aa666: Status 404 returned error can't find the container with id 1719cafbeb78511b9834852800dddabe50e4501cbb91cdb0292282a6a14aa666
Jul 23 17:59:15.966743 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:15.966710    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r"]
Jul 23 17:59:15.970174 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:59:15.970144    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0482d1f_b722_4c45_8d62_9f731187c0c3.slice/crio-4a22f6c5f59132f54056142df3615457e2e74da7b861f8577898e3371fc30871 WatchSource:0}: Error finding container 4a22f6c5f59132f54056142df3615457e2e74da7b861f8577898e3371fc30871: Status 404 returned error can't find the container with id 4a22f6c5f59132f54056142df3615457e2e74da7b861f8577898e3371fc30871
Jul 23 17:59:16.313968 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:16.313932    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nfps8" event={"ID":"4faaf47a-401c-4b15-b098-077b2dc474ab","Type":"ContainerStarted","Data":"dde939ce7624b13a0776dce38d5d80cfa7021cf0bad5d5cc7a9ab7ab22bf413b"}
Jul 23 17:59:16.315194 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:16.315169    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r" event={"ID":"b0482d1f-b722-4c45-8d62-9f731187c0c3","Type":"ContainerStarted","Data":"4a22f6c5f59132f54056142df3615457e2e74da7b861f8577898e3371fc30871"}
Jul 23 17:59:16.316151 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:16.316134    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d" event={"ID":"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8","Type":"ContainerStarted","Data":"1719cafbeb78511b9834852800dddabe50e4501cbb91cdb0292282a6a14aa666"}
Jul 23 17:59:16.337797 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:16.337733    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nfps8" podStartSLOduration=16.849625065 podStartE2EDuration="29.33772062s" totalImagesPullingTime="12.488095555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 17:58:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:16.337186325 +0000 UTC m=+98.169877483" watchObservedRunningTime="2026-07-23 17:59:16.33772062 +0000 UTC m=+98.170411778"
Jul 23 17:59:17.956740 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:17.956700    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:59:17.960514 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:17.960190    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c-metrics-tls\") pod \"dns-default-98bl8\" (UID: \"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c\") " pod="openshift-dns/dns-default-98bl8"
Jul 23 17:59:18.005715 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:18.005684    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-djwnl\""
Jul 23 17:59:18.013840 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:18.013814    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-98bl8"
Jul 23 17:59:20.032045 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:20.032025    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-98bl8"]
Jul 23 17:59:20.035169 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:59:20.035135    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d0cd5f_00b4_4fa7_b78f_e09deca27e1c.slice/crio-551a6233fc22348297ad5b6a9ac030a0f04169255e4b53643f781c47ad163c6f WatchSource:0}: Error finding container 551a6233fc22348297ad5b6a9ac030a0f04169255e4b53643f781c47ad163c6f: Status 404 returned error can't find the container with id 551a6233fc22348297ad5b6a9ac030a0f04169255e4b53643f781c47ad163c6f
Jul 23 17:59:20.331387 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:20.331352    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r" event={"ID":"b0482d1f-b722-4c45-8d62-9f731187c0c3","Type":"ContainerStarted","Data":"967372fdc256b84942f38ef948d0e30a878a0f9cb8b77d97bba933518360c853"}
Jul 23 17:59:20.331562 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:20.331397    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r" event={"ID":"b0482d1f-b722-4c45-8d62-9f731187c0c3","Type":"ContainerStarted","Data":"41b8bac6efda0b9af8f62e7d8b6482d915aa9874f83e4014ddcf3ffe31bb6ab4"}
Jul 23 17:59:20.331562 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:20.331416    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r" event={"ID":"b0482d1f-b722-4c45-8d62-9f731187c0c3","Type":"ContainerStarted","Data":"36ef5f7138694f55adca72e0a9188d2474473e90a8866ab1426ced0ce39b643e"}
Jul 23 17:59:20.332921 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:20.332892    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d" event={"ID":"d43c0b9e-9e41-44ea-adc1-342ba12f3ef8","Type":"ContainerStarted","Data":"277f9a5c43e228ff9788eb953239b60fa6e1df64a4f3ad997dc2dbd2b3caf0a2"}
Jul 23 17:59:20.334006 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:20.333983    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98bl8" event={"ID":"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c","Type":"ContainerStarted","Data":"551a6233fc22348297ad5b6a9ac030a0f04169255e4b53643f781c47ad163c6f"}
Jul 23 17:59:20.362363 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:20.362315    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b86dcc9-5tg9r" podStartSLOduration=4.366639206 podStartE2EDuration="8.362299828s" totalImagesPullingTime="3.995660622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:20.35927757 +0000 UTC m=+102.191968727" watchObservedRunningTime="2026-07-23 17:59:20.362299828 +0000 UTC m=+102.194990986"
Jul 23 17:59:20.381001 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:20.380958    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-s479d" podStartSLOduration=35.324317389 podStartE2EDuration="39.380944782s" totalImagesPullingTime="4.056627393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:20.380366414 +0000 UTC m=+102.213057573" watchObservedRunningTime="2026-07-23 17:59:20.380944782 +0000 UTC m=+102.213635918"
Jul 23 17:59:21.227110 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:21.227075    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sh98p"
Jul 23 17:59:22.211782 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:22.211738    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:59:22.341801 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:22.341768    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98bl8" event={"ID":"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c","Type":"ContainerStarted","Data":"83d29055c5efe8c4e35056202ad36d47facd3a60cc0fc6f5564a25b72243ebeb"}
Jul 23 17:59:22.342203 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:22.341824    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-98bl8" event={"ID":"e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c","Type":"ContainerStarted","Data":"0bdd4fdaa12c872b2a0e750195c0c8b9058a18deeebabf6b41b604867de4462d"}
Jul 23 17:59:22.342203 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:22.341915    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-98bl8"
Jul 23 17:59:22.366484 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:22.366431    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-98bl8" podStartSLOduration=66.784914292 podStartE2EDuration="1m8.366414455s" totalImagesPullingTime="1.581500163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:22.365795638 +0000 UTC m=+104.198486796" watchObservedRunningTime="2026-07-23 17:59:22.366414455 +0000 UTC m=+104.199105612"
Jul 23 17:59:24.607811 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.607783    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"]
Jul 23 17:59:24.629606 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.629579    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"]
Jul 23 17:59:24.629729 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.629683    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.632436 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.632414    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 17:59:24.633307 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.633284    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 17:59:24.633414 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.633328    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 17:59:24.633465 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.633407    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h6bqh\""
Jul 23 17:59:24.710518 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.710491    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.710648 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.710532    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkj4s\" (UniqueName: \"kubernetes.io/projected/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-kube-api-access-pkj4s\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.710648 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.710601    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.710648 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.710622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.811212 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.811179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.811393 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.811234    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkj4s\" (UniqueName: \"kubernetes.io/projected/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-kube-api-access-pkj4s\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.811393 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.811286    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.811393 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.811309    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.811985 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.811963    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.813691 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.813670    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.813795 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.813773    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.820486 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.820467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkj4s\" (UniqueName: \"kubernetes.io/projected/43ebd81f-5c0c-4517-b0a0-f27f9a3a6876-kube-api-access-pkj4s\") pod \"prometheus-operator-5945b5cfd-ft28k\" (UID: \"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:24.938874 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:24.938790    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"
Jul 23 17:59:25.083533 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:25.083499    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ft28k"]
Jul 23 17:59:25.086201 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:59:25.086176    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ebd81f_5c0c_4517_b0a0_f27f9a3a6876.slice/crio-4249cc55051768c505b1e0409e3a6f4bc2c0f9ac15fd343626603f0054e45ea0 WatchSource:0}: Error finding container 4249cc55051768c505b1e0409e3a6f4bc2c0f9ac15fd343626603f0054e45ea0: Status 404 returned error can't find the container with id 4249cc55051768c505b1e0409e3a6f4bc2c0f9ac15fd343626603f0054e45ea0
Jul 23 17:59:25.353424 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:25.353393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k" event={"ID":"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876","Type":"ContainerStarted","Data":"4249cc55051768c505b1e0409e3a6f4bc2c0f9ac15fd343626603f0054e45ea0"}
Jul 23 17:59:27.361687 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:27.361651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k" event={"ID":"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876","Type":"ContainerStarted","Data":"bca33e29ff91f274c04f7d3713145c6cec00785787431763123b5b47cef3d64e"}
Jul 23 17:59:27.362077 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:27.361710    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k" event={"ID":"43ebd81f-5c0c-4517-b0a0-f27f9a3a6876","Type":"ContainerStarted","Data":"580755fbb70b795e67cfc19c2c7600b0b67439de57be5d818db817b16146b7ae"}
Jul 23 17:59:27.382952 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:27.382895    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ft28k" podStartSLOduration=1.945211909 podStartE2EDuration="3.382873987s" totalImagesPullingTime="1.437662078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:27.382644133 +0000 UTC m=+109.215335315" watchObservedRunningTime="2026-07-23 17:59:27.382873987 +0000 UTC m=+109.215565140"
Jul 23 17:59:29.168793 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.168744    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r7nsq"]
Jul 23 17:59:29.171974 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.171957    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.175582 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.175555    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 17:59:29.175687 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.175605    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 17:59:29.180139 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.179951    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 17:59:29.181908 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.181218    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c7sl6\""
Jul 23 17:59:29.344985 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.344949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-wtmp\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.345162 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.344993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-accelerators-collector-config\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.345162 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.345076    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bfcaf42-b00d-416d-ae6f-12523d7033da-metrics-client-ca\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.345162 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.345134    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-sys\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.345272 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.345161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.345272 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.345182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-root\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.345272 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.345197    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-textfile\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.345272 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.345217    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.345272 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.345234    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8srv\" (UniqueName: \"kubernetes.io/projected/3bfcaf42-b00d-416d-ae6f-12523d7033da-kube-api-access-h8srv\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.445732 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bfcaf42-b00d-416d-ae6f-12523d7033da-metrics-client-ca\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.445732 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445689    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-sys\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.445732 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445714    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.445732 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445731    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-root\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445746    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-textfile\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445796    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445806    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-sys\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445818    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-root\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8srv\" (UniqueName: \"kubernetes.io/projected/3bfcaf42-b00d-416d-ae6f-12523d7033da-kube-api-access-h8srv\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:59:29.445899    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.445933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-wtmp\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:59:29.445963    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls podName:3bfcaf42-b00d-416d-ae6f-12523d7033da nodeName:}" failed. No retries permitted until 2026-07-23 17:59:29.945944258 +0000 UTC m=+111.778635394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls") pod "node-exporter-r7nsq" (UID: "3bfcaf42-b00d-416d-ae6f-12523d7033da") : secret "node-exporter-tls" not found
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.446005    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-accelerators-collector-config\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446061 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.446048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-wtmp\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446410 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.446312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-textfile\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446410 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.446397    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bfcaf42-b00d-416d-ae6f-12523d7033da-metrics-client-ca\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.446473 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.446450    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-accelerators-collector-config\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.448094 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.448076    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.469174 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.469146    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8srv\" (UniqueName: \"kubernetes.io/projected/3bfcaf42-b00d-416d-ae6f-12523d7033da-kube-api-access-h8srv\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.950896 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:29.950852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:29.951112 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:59:29.951054    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 17:59:29.951178 ip-10-0-129-70 kubenswrapper[2572]: E0723 17:59:29.951137    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls podName:3bfcaf42-b00d-416d-ae6f-12523d7033da nodeName:}" failed. No retries permitted until 2026-07-23 17:59:30.951114987 +0000 UTC m=+112.783806126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls") pod "node-exporter-r7nsq" (UID: "3bfcaf42-b00d-416d-ae6f-12523d7033da") : secret "node-exporter-tls" not found
Jul 23 17:59:30.958119 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:30.958079    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:30.961016 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:30.960982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3bfcaf42-b00d-416d-ae6f-12523d7033da-node-exporter-tls\") pod \"node-exporter-r7nsq\" (UID: \"3bfcaf42-b00d-416d-ae6f-12523d7033da\") " pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:30.981987 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:30.981956    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r7nsq"
Jul 23 17:59:30.992189 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:59:30.992162    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bfcaf42_b00d_416d_ae6f_12523d7033da.slice/crio-3a70a15202c19507be16e7321f2f2eaf234ffdcd1e48c24f08d9ac99af02f690 WatchSource:0}: Error finding container 3a70a15202c19507be16e7321f2f2eaf234ffdcd1e48c24f08d9ac99af02f690: Status 404 returned error can't find the container with id 3a70a15202c19507be16e7321f2f2eaf234ffdcd1e48c24f08d9ac99af02f690
Jul 23 17:59:31.375172 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:31.375134    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r7nsq" event={"ID":"3bfcaf42-b00d-416d-ae6f-12523d7033da","Type":"ContainerStarted","Data":"3a70a15202c19507be16e7321f2f2eaf234ffdcd1e48c24f08d9ac99af02f690"}
Jul 23 17:59:32.347223 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:32.347188    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-98bl8"
Jul 23 17:59:32.380021 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:32.379986    2572 generic.go:356] "Generic (PLEG): container finished" podID="3bfcaf42-b00d-416d-ae6f-12523d7033da" containerID="eea3d28a3ebda5fcae62ebe06084bfcd35739116d50c52ca747331fd0b614c0d" exitCode=0
Jul 23 17:59:32.380177 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:32.380076    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r7nsq" event={"ID":"3bfcaf42-b00d-416d-ae6f-12523d7033da","Type":"ContainerDied","Data":"eea3d28a3ebda5fcae62ebe06084bfcd35739116d50c52ca747331fd0b614c0d"}
Jul 23 17:59:33.385283 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:33.385250    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r7nsq" event={"ID":"3bfcaf42-b00d-416d-ae6f-12523d7033da","Type":"ContainerStarted","Data":"8e20fa882779bf254b659adc0862636704d91d2f064063fe4421c6b1265d719b"}
Jul 23 17:59:33.385666 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:33.385302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r7nsq" event={"ID":"3bfcaf42-b00d-416d-ae6f-12523d7033da","Type":"ContainerStarted","Data":"82a324741ca78519de89a132ec7651fdafdfba608950ff9ec0063de54082a966"}
Jul 23 17:59:33.413079 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:33.413029    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r7nsq" podStartSLOduration=3.201106564 podStartE2EDuration="4.413014108s" totalImagesPullingTime="1.146468971s" totalInitContainerRuntime="65.438573ms" isStatefulPod=true podCreationTimestamp="2026-07-23 17:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:33.411657959 +0000 UTC m=+115.244349117" watchObservedRunningTime="2026-07-23 17:59:33.413014108 +0000 UTC m=+115.245705266"
Jul 23 17:59:37.226874 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.226801    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54ddffc497-95dzd" podUID="7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" containerName="registry" containerID="cri-o://86275a6ec249b2cb1656b6bb68e1dc3c9139c13da4a84d601ee79861c24f3f4e" gracePeriod=30
Jul 23 17:59:37.399509 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.399472    2572 generic.go:356] "Generic (PLEG): container finished" podID="7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" containerID="86275a6ec249b2cb1656b6bb68e1dc3c9139c13da4a84d601ee79861c24f3f4e" exitCode=0
Jul 23 17:59:37.399653 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.399529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54ddffc497-95dzd" event={"ID":"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4","Type":"ContainerDied","Data":"86275a6ec249b2cb1656b6bb68e1dc3c9139c13da4a84d601ee79861c24f3f4e"}
Jul 23 17:59:37.463487 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.463466    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:59:37.618423 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618380    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-trusted-ca\") pod \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") "
Jul 23 17:59:37.618423 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618424    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") pod \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") "
Jul 23 17:59:37.618627 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618446    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-ca-trust-extracted\") pod \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") "
Jul 23 17:59:37.618627 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618559    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-installation-pull-secrets\") pod \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") "
Jul 23 17:59:37.618691 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618630    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bc49\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-kube-api-access-9bc49\") pod \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") "
Jul 23 17:59:37.618691 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618673    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-certificates\") pod \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") "
Jul 23 17:59:37.618801 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618717    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-bound-sa-token\") pod \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") "
Jul 23 17:59:37.618801 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618787    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-image-registry-private-configuration\") pod \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\" (UID: \"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4\") "
Jul 23 17:59:37.618914 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.618891    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 17:59:37.619178 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.619143    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-trusted-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 17:59:37.619178 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.619158    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 17:59:37.620886 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.620858    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 17:59:37.621031 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.621009    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:59:37.621220 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.621190    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-kube-api-access-9bc49" (OuterVolumeSpecName: "kube-api-access-9bc49") pod "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4"). InnerVolumeSpecName "kube-api-access-9bc49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:59:37.621320 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.621281    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 17:59:37.621372 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.621351    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 17:59:37.627285 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.627263    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" (UID: "7ca3f3ad-7957-42e3-98b9-93f405e9c8c4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 17:59:37.720359 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.720329    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-ca-trust-extracted\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 17:59:37.720359 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.720354    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-installation-pull-secrets\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 17:59:37.720359 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.720365    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bc49\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-kube-api-access-9bc49\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 17:59:37.720568 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.720375    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-certificates\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 17:59:37.720568 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.720384    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-bound-sa-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 17:59:37.720568 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.720393    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-image-registry-private-configuration\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 17:59:37.720568 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:37.720402    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4-registry-tls\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 17:59:38.403558 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:38.403526    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54ddffc497-95dzd"
Jul 23 17:59:38.404028 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:38.403532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54ddffc497-95dzd" event={"ID":"7ca3f3ad-7957-42e3-98b9-93f405e9c8c4","Type":"ContainerDied","Data":"2983ecb3331806a83708c2433d3ba82149f6eee3d935913a4a985c7592b028e0"}
Jul 23 17:59:38.404028 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:38.403662    2572 scope.go:117] "RemoveContainer" containerID="86275a6ec249b2cb1656b6bb68e1dc3c9139c13da4a84d601ee79861c24f3f4e"
Jul 23 17:59:38.428615 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:38.428589    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54ddffc497-95dzd"]
Jul 23 17:59:38.432389 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:38.432370    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54ddffc497-95dzd"]
Jul 23 17:59:38.792259 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:38.792227    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" path="/var/lib/kubelet/pods/7ca3f3ad-7957-42e3-98b9-93f405e9c8c4/volumes"
Jul 23 17:59:47.296762 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:47.296724    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:59:47.299073 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:47.299046    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215-metrics-certs\") pod \"network-metrics-daemon-4ph55\" (UID: \"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215\") " pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:59:47.511491 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:47.511466    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7wdhp\""
Jul 23 17:59:47.516454 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:47.516436    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ph55"
Jul 23 17:59:47.717875 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:47.717848    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4ph55"]
Jul 23 17:59:47.720314 ip-10-0-129-70 kubenswrapper[2572]: W0723 17:59:47.720290    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535cb0bc_3a2e_4d0b_b1ad_f6f8a43b5215.slice/crio-e26cb74c897225a9783f1da94405bdd560950a395e53dd982d84c7e9641af5f0 WatchSource:0}: Error finding container e26cb74c897225a9783f1da94405bdd560950a395e53dd982d84c7e9641af5f0: Status 404 returned error can't find the container with id e26cb74c897225a9783f1da94405bdd560950a395e53dd982d84c7e9641af5f0
Jul 23 17:59:48.439404 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:48.439364    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ph55" event={"ID":"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215","Type":"ContainerStarted","Data":"e26cb74c897225a9783f1da94405bdd560950a395e53dd982d84c7e9641af5f0"}
Jul 23 17:59:49.444462 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:49.444420    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ph55" event={"ID":"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215","Type":"ContainerStarted","Data":"e23ae449dc8199cdf523b5aca5c9d65d2a46eb0273f2a02cdef7bebebb3ebbe1"}
Jul 23 17:59:49.444864 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:49.444516    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ph55" event={"ID":"535cb0bc-3a2e-4d0b-b1ad-f6f8a43b5215","Type":"ContainerStarted","Data":"01785e201f3ede17f2162ed84bae1b56e3f5a5f52478fba6830672f65c7f26af"}
Jul 23 17:59:49.467075 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:49.467026    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4ph55" podStartSLOduration=129.337025787 podStartE2EDuration="2m10.467011022s" totalImagesPullingTime="1.129985235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 17:59:49.465925116 +0000 UTC m=+131.298616288" watchObservedRunningTime="2026-07-23 17:59:49.467011022 +0000 UTC m=+131.299702205"
Jul 23 17:59:57.469959 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:57.469924    2572 generic.go:356] "Generic (PLEG): container finished" podID="9d8a3ee6-8122-4e53-b466-41d3775ec235" containerID="45496a17a3bb5cb538309b4eca3591a94910002eabaf6b236332fd58521d9936" exitCode=0
Jul 23 17:59:57.470339 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:57.469973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-j8wfq" event={"ID":"9d8a3ee6-8122-4e53-b466-41d3775ec235","Type":"ContainerDied","Data":"45496a17a3bb5cb538309b4eca3591a94910002eabaf6b236332fd58521d9936"}
Jul 23 17:59:57.470339 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:57.470279    2572 scope.go:117] "RemoveContainer" containerID="45496a17a3bb5cb538309b4eca3591a94910002eabaf6b236332fd58521d9936"
Jul 23 17:59:58.475402 ip-10-0-129-70 kubenswrapper[2572]: I0723 17:59:58.475372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-j8wfq" event={"ID":"9d8a3ee6-8122-4e53-b466-41d3775ec235","Type":"ContainerStarted","Data":"3c20ea84fe845b555fba602058fba33b4d714886f5afa16cef8a8ea17cd18974"}
Jul 23 18:00:12.521273 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:00:12.521240    2572 generic.go:356] "Generic (PLEG): container finished" podID="2dd9b948-a4de-4bcf-ba1b-28b0f189c20a" containerID="f83ec4efdc20ed0b4d261fc73b17013f9ec1adaef4e14df471bc361a4a4c412d" exitCode=0
Jul 23 18:00:12.521708 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:00:12.521318    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b" event={"ID":"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a","Type":"ContainerDied","Data":"f83ec4efdc20ed0b4d261fc73b17013f9ec1adaef4e14df471bc361a4a4c412d"}
Jul 23 18:00:12.521708 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:00:12.521619    2572 scope.go:117] "RemoveContainer" containerID="f83ec4efdc20ed0b4d261fc73b17013f9ec1adaef4e14df471bc361a4a4c412d"
Jul 23 18:00:13.527164 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:00:13.527127    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-xpw5b" event={"ID":"2dd9b948-a4de-4bcf-ba1b-28b0f189c20a","Type":"ContainerStarted","Data":"299114ec700ce30e174b96eed6f5be5960efe043d212502bf7d0b1aaa9012357"}
Jul 23 18:01:32.829675 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.829634    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"]
Jul 23 18:01:32.830204 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.829999    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" containerName="registry"
Jul 23 18:01:32.830204 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.830016    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" containerName="registry"
Jul 23 18:01:32.830204 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.830075    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca3f3ad-7957-42e3-98b9-93f405e9c8c4" containerName="registry"
Jul 23 18:01:32.833040 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.833020    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:32.837369 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.837349    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 18:01:32.838373 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.838352    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8np6d\""
Jul 23 18:01:32.838373 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.838365    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 18:01:32.846521 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.846503    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"]
Jul 23 18:01:32.907538 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.907512    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:32.907660 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.907549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:32.907660 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:32.907571    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwkgg\" (UniqueName: \"kubernetes.io/projected/97869fcc-adf8-4b13-8158-c5fdb5989186-kube-api-access-mwkgg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:33.008636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.008608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:33.008636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.008638    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:33.008815 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.008661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwkgg\" (UniqueName: \"kubernetes.io/projected/97869fcc-adf8-4b13-8158-c5fdb5989186-kube-api-access-mwkgg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:33.008994 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.008977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:33.009063 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.009046    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:33.017805 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.017777    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwkgg\" (UniqueName: \"kubernetes.io/projected/97869fcc-adf8-4b13-8158-c5fdb5989186-kube-api-access-mwkgg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:33.141862 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.141805    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:33.276403 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.276373    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"]
Jul 23 18:01:33.279308 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:01:33.279276    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97869fcc_adf8_4b13_8158_c5fdb5989186.slice/crio-55ba5b5bfc033ab04ff33879baaa122ad02af34d5ee9510efca714e0208462bf WatchSource:0}: Error finding container 55ba5b5bfc033ab04ff33879baaa122ad02af34d5ee9510efca714e0208462bf: Status 404 returned error can't find the container with id 55ba5b5bfc033ab04ff33879baaa122ad02af34d5ee9510efca714e0208462bf
Jul 23 18:01:33.790278 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:33.790250    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4" event={"ID":"97869fcc-adf8-4b13-8158-c5fdb5989186","Type":"ContainerStarted","Data":"55ba5b5bfc033ab04ff33879baaa122ad02af34d5ee9510efca714e0208462bf"}
Jul 23 18:01:40.815059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:40.815028    2572 generic.go:356] "Generic (PLEG): container finished" podID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerID="2b49495c2fba8ee8a977205a656f2375cab2bc7e973a2394d167c057574719cd" exitCode=0
Jul 23 18:01:40.815379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:40.815107    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4" event={"ID":"97869fcc-adf8-4b13-8158-c5fdb5989186","Type":"ContainerDied","Data":"2b49495c2fba8ee8a977205a656f2375cab2bc7e973a2394d167c057574719cd"}
Jul 23 18:01:44.829213 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:44.829185    2572 generic.go:356] "Generic (PLEG): container finished" podID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerID="9a92218f37a8a9bc62a9ff5408487786834f468da878b7735206ad087a53fdb8" exitCode=0
Jul 23 18:01:44.829582 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:44.829232    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4" event={"ID":"97869fcc-adf8-4b13-8158-c5fdb5989186","Type":"ContainerDied","Data":"9a92218f37a8a9bc62a9ff5408487786834f468da878b7735206ad087a53fdb8"}
Jul 23 18:01:52.861392 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:52.861355    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4" event={"ID":"97869fcc-adf8-4b13-8158-c5fdb5989186","Type":"ContainerStarted","Data":"331205565e96a2278c072f9d8ed3f5b2d77ae19ba9b2c29c49ca79aca4ee297c"}
Jul 23 18:01:52.883916 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:52.883869    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4" podStartSLOduration=1.841362283 podStartE2EDuration="20.883853727s" totalImagesPullingTime="19.042491444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:01:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:01:52.882356387 +0000 UTC m=+254.715047555" watchObservedRunningTime="2026-07-23 18:01:52.883853727 +0000 UTC m=+254.716544885"
Jul 23 18:01:53.866348 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:53.866314    2572 generic.go:356] "Generic (PLEG): container finished" podID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerID="331205565e96a2278c072f9d8ed3f5b2d77ae19ba9b2c29c49ca79aca4ee297c" exitCode=0
Jul 23 18:01:53.866710 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:53.866376    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4" event={"ID":"97869fcc-adf8-4b13-8158-c5fdb5989186","Type":"ContainerDied","Data":"331205565e96a2278c072f9d8ed3f5b2d77ae19ba9b2c29c49ca79aca4ee297c"}
Jul 23 18:01:54.988164 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:54.988142    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:55.073481 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.073448    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-bundle\") pod \"97869fcc-adf8-4b13-8158-c5fdb5989186\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") "
Jul 23 18:01:55.073633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.073504    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwkgg\" (UniqueName: \"kubernetes.io/projected/97869fcc-adf8-4b13-8158-c5fdb5989186-kube-api-access-mwkgg\") pod \"97869fcc-adf8-4b13-8158-c5fdb5989186\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") "
Jul 23 18:01:55.073633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.073538    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-util\") pod \"97869fcc-adf8-4b13-8158-c5fdb5989186\" (UID: \"97869fcc-adf8-4b13-8158-c5fdb5989186\") "
Jul 23 18:01:55.074150 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.074120    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-bundle" (OuterVolumeSpecName: "bundle") pod "97869fcc-adf8-4b13-8158-c5fdb5989186" (UID: "97869fcc-adf8-4b13-8158-c5fdb5989186"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:01:55.075782 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.075736    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97869fcc-adf8-4b13-8158-c5fdb5989186-kube-api-access-mwkgg" (OuterVolumeSpecName: "kube-api-access-mwkgg") pod "97869fcc-adf8-4b13-8158-c5fdb5989186" (UID: "97869fcc-adf8-4b13-8158-c5fdb5989186"). InnerVolumeSpecName "kube-api-access-mwkgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:01:55.078058 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.078039    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-util" (OuterVolumeSpecName: "util") pod "97869fcc-adf8-4b13-8158-c5fdb5989186" (UID: "97869fcc-adf8-4b13-8158-c5fdb5989186"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:01:55.174913 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.174838    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-bundle\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:01:55.174913 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.174866    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwkgg\" (UniqueName: \"kubernetes.io/projected/97869fcc-adf8-4b13-8158-c5fdb5989186-kube-api-access-mwkgg\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:01:55.174913 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.174877    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97869fcc-adf8-4b13-8158-c5fdb5989186-util\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:01:55.874608 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.874580    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4"
Jul 23 18:01:55.874794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.874579    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754048xk4" event={"ID":"97869fcc-adf8-4b13-8158-c5fdb5989186","Type":"ContainerDied","Data":"55ba5b5bfc033ab04ff33879baaa122ad02af34d5ee9510efca714e0208462bf"}
Jul 23 18:01:55.874794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:01:55.874703    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55ba5b5bfc033ab04ff33879baaa122ad02af34d5ee9510efca714e0208462bf"
Jul 23 18:02:08.513022 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.512941    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mvhfv"]
Jul 23 18:02:08.513474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.513191    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerName="util"
Jul 23 18:02:08.513474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.513201    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerName="util"
Jul 23 18:02:08.513474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.513213    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerName="extract"
Jul 23 18:02:08.513474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.513218    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerName="extract"
Jul 23 18:02:08.513474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.513229    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerName="pull"
Jul 23 18:02:08.513474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.513235    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerName="pull"
Jul 23 18:02:08.513474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.513277    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="97869fcc-adf8-4b13-8158-c5fdb5989186" containerName="extract"
Jul 23 18:02:08.515995 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.515979    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:08.518825 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.518804    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mbwt5\""
Jul 23 18:02:08.519930 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.519911    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 18:02:08.520026 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.519928    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 18:02:08.535507 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.535483    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mvhfv"]
Jul 23 18:02:08.567597 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.567563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23443da2-946a-4025-be6b-84f5febca0d0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mvhfv\" (UID: \"23443da2-946a-4025-be6b-84f5febca0d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:08.567737 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.567617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mq6x\" (UniqueName: \"kubernetes.io/projected/23443da2-946a-4025-be6b-84f5febca0d0-kube-api-access-7mq6x\") pod \"cert-manager-webhook-6486ffd997-mvhfv\" (UID: \"23443da2-946a-4025-be6b-84f5febca0d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:08.668953 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.668923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mq6x\" (UniqueName: \"kubernetes.io/projected/23443da2-946a-4025-be6b-84f5febca0d0-kube-api-access-7mq6x\") pod \"cert-manager-webhook-6486ffd997-mvhfv\" (UID: \"23443da2-946a-4025-be6b-84f5febca0d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:08.669139 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.669004    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23443da2-946a-4025-be6b-84f5febca0d0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mvhfv\" (UID: \"23443da2-946a-4025-be6b-84f5febca0d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:08.687530 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.687505    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mq6x\" (UniqueName: \"kubernetes.io/projected/23443da2-946a-4025-be6b-84f5febca0d0-kube-api-access-7mq6x\") pod \"cert-manager-webhook-6486ffd997-mvhfv\" (UID: \"23443da2-946a-4025-be6b-84f5febca0d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:08.687660 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.687641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23443da2-946a-4025-be6b-84f5febca0d0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mvhfv\" (UID: \"23443da2-946a-4025-be6b-84f5febca0d0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:08.823893 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.823803    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:08.950843 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:08.950816    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mvhfv"]
Jul 23 18:02:08.952588 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:02:08.952564    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23443da2_946a_4025_be6b_84f5febca0d0.slice/crio-20e15f2c90365a7733b80e71986c369dfdd5d26856c73680f76c509ffc69b70a WatchSource:0}: Error finding container 20e15f2c90365a7733b80e71986c369dfdd5d26856c73680f76c509ffc69b70a: Status 404 returned error can't find the container with id 20e15f2c90365a7733b80e71986c369dfdd5d26856c73680f76c509ffc69b70a
Jul 23 18:02:09.925642 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:09.925602    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv" event={"ID":"23443da2-946a-4025-be6b-84f5febca0d0","Type":"ContainerStarted","Data":"20e15f2c90365a7733b80e71986c369dfdd5d26856c73680f76c509ffc69b70a"}
Jul 23 18:02:11.938975 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:11.938885    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv" event={"ID":"23443da2-946a-4025-be6b-84f5febca0d0","Type":"ContainerStarted","Data":"738a0cc06408c3165e3b335bf557de566961720a173604442d2fd167a534a753"}
Jul 23 18:02:11.938975 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:11.938933    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:11.983541 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:11.983430    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv" podStartSLOduration=1.387252443 podStartE2EDuration="3.983410862s" totalImagesPullingTime="2.596158419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:11.982947946 +0000 UTC m=+273.815639134" watchObservedRunningTime="2026-07-23 18:02:11.983410862 +0000 UTC m=+273.816102020"
Jul 23 18:02:17.945108 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:17.945076    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mvhfv"
Jul 23 18:02:29.610602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.610568    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"]
Jul 23 18:02:29.612468 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.612452    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"
Jul 23 18:02:29.615945 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.615924    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:29.616421 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.616406    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:29.616510 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.616421    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qbg7r\""
Jul 23 18:02:29.631858 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.631838    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"]
Jul 23 18:02:29.727845 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.727814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr54k\" (UniqueName: \"kubernetes.io/projected/89616a86-e047-4e82-a611-fa853f3e5865-kube-api-access-rr54k\") pod \"openshift-lws-operator-fd8ccff4c-bfp47\" (UID: \"89616a86-e047-4e82-a611-fa853f3e5865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"
Jul 23 18:02:29.727983 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.727891    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89616a86-e047-4e82-a611-fa853f3e5865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bfp47\" (UID: \"89616a86-e047-4e82-a611-fa853f3e5865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"
Jul 23 18:02:29.828535 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.828508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89616a86-e047-4e82-a611-fa853f3e5865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bfp47\" (UID: \"89616a86-e047-4e82-a611-fa853f3e5865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"
Jul 23 18:02:29.828617 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.828544    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr54k\" (UniqueName: \"kubernetes.io/projected/89616a86-e047-4e82-a611-fa853f3e5865-kube-api-access-rr54k\") pod \"openshift-lws-operator-fd8ccff4c-bfp47\" (UID: \"89616a86-e047-4e82-a611-fa853f3e5865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"
Jul 23 18:02:29.829029 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.829008    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89616a86-e047-4e82-a611-fa853f3e5865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bfp47\" (UID: \"89616a86-e047-4e82-a611-fa853f3e5865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"
Jul 23 18:02:29.838137 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.838114    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr54k\" (UniqueName: \"kubernetes.io/projected/89616a86-e047-4e82-a611-fa853f3e5865-kube-api-access-rr54k\") pod \"openshift-lws-operator-fd8ccff4c-bfp47\" (UID: \"89616a86-e047-4e82-a611-fa853f3e5865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"
Jul 23 18:02:29.920843 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:29.920780    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"
Jul 23 18:02:30.043851 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:30.043820    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47"]
Jul 23 18:02:30.046654 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:02:30.046630    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89616a86_e047_4e82_a611_fa853f3e5865.slice/crio-37a801ccc6c67e48f0aa528906cba8884832512157427380fa27f2bdd34d090a WatchSource:0}: Error finding container 37a801ccc6c67e48f0aa528906cba8884832512157427380fa27f2bdd34d090a: Status 404 returned error can't find the container with id 37a801ccc6c67e48f0aa528906cba8884832512157427380fa27f2bdd34d090a
Jul 23 18:02:31.004681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:31.004645    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47" event={"ID":"89616a86-e047-4e82-a611-fa853f3e5865","Type":"ContainerStarted","Data":"37a801ccc6c67e48f0aa528906cba8884832512157427380fa27f2bdd34d090a"}
Jul 23 18:02:35.020567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:35.020532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47" event={"ID":"89616a86-e047-4e82-a611-fa853f3e5865","Type":"ContainerStarted","Data":"3582835c062d316f51a17d28862e7c12c34237dee1294cc3d9d2b1fd299112b8"}
Jul 23 18:02:35.045159 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:35.045113    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bfp47" podStartSLOduration=1.635812931 podStartE2EDuration="6.045098704s" totalImagesPullingTime="4.409285773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:35.0441935 +0000 UTC m=+296.876884658" watchObservedRunningTime="2026-07-23 18:02:35.045098704 +0000 UTC m=+296.877789862"
Jul 23 18:02:37.682667 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.682635    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"]
Jul 23 18:02:37.685965 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.685944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.686259 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.686222    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.686259 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.686262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.686402 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.686297    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zzlk\" (UniqueName: \"kubernetes.io/projected/d7f15595-aee2-4eac-8012-a74860c2a7a6-kube-api-access-6zzlk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.689466 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.689449    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8np6d\""
Jul 23 18:02:37.689596 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.689581    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 18:02:37.690515 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.690496    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 18:02:37.699518 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.699497    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"]
Jul 23 18:02:37.786976 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.786945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.786976 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.786977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.787171 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.787021    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zzlk\" (UniqueName: \"kubernetes.io/projected/d7f15595-aee2-4eac-8012-a74860c2a7a6-kube-api-access-6zzlk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.787378 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.787356    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.787440 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.787362    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.800040 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.800013    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zzlk\" (UniqueName: \"kubernetes.io/projected/d7f15595-aee2-4eac-8012-a74860c2a7a6-kube-api-access-6zzlk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:37.994803 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:37.994704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:38.119326 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:38.119296    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"]
Jul 23 18:02:38.122065 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:02:38.122040    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f15595_aee2_4eac_8012_a74860c2a7a6.slice/crio-5c4038c8844dcc46bbc3b8d9c5610a6c86abeefbfbed65f80cc4f737e0e80022 WatchSource:0}: Error finding container 5c4038c8844dcc46bbc3b8d9c5610a6c86abeefbfbed65f80cc4f737e0e80022: Status 404 returned error can't find the container with id 5c4038c8844dcc46bbc3b8d9c5610a6c86abeefbfbed65f80cc4f737e0e80022
Jul 23 18:02:38.482999 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:38.482978    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 18:02:39.037196 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:39.037166    2572 generic.go:356] "Generic (PLEG): container finished" podID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerID="68accf7ed31168912c476fcaccec2ad732a4b9c07a41ffcc1c64e7eab98a53d8" exitCode=0
Jul 23 18:02:39.039491 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:39.037253    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv" event={"ID":"d7f15595-aee2-4eac-8012-a74860c2a7a6","Type":"ContainerDied","Data":"68accf7ed31168912c476fcaccec2ad732a4b9c07a41ffcc1c64e7eab98a53d8"}
Jul 23 18:02:39.039491 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:39.037299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv" event={"ID":"d7f15595-aee2-4eac-8012-a74860c2a7a6","Type":"ContainerStarted","Data":"5c4038c8844dcc46bbc3b8d9c5610a6c86abeefbfbed65f80cc4f737e0e80022"}
Jul 23 18:02:40.042816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:40.042782    2572 generic.go:356] "Generic (PLEG): container finished" podID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerID="2e609b26f8213f68498448414c6f115a3faee8b38a44dd9625c351eca914bbcc" exitCode=0
Jul 23 18:02:40.043166 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:40.042876    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv" event={"ID":"d7f15595-aee2-4eac-8012-a74860c2a7a6","Type":"ContainerDied","Data":"2e609b26f8213f68498448414c6f115a3faee8b38a44dd9625c351eca914bbcc"}
Jul 23 18:02:41.050343 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:41.050310    2572 generic.go:356] "Generic (PLEG): container finished" podID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerID="11856bda3b0e673e5c7d436ca8b25e0df8da49395e015dc6d1d889f0d1307ce8" exitCode=0
Jul 23 18:02:41.050689 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:41.050394    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv" event={"ID":"d7f15595-aee2-4eac-8012-a74860c2a7a6","Type":"ContainerDied","Data":"11856bda3b0e673e5c7d436ca8b25e0df8da49395e015dc6d1d889f0d1307ce8"}
Jul 23 18:02:42.177958 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.177937    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:42.217694 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.217658    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-util\") pod \"d7f15595-aee2-4eac-8012-a74860c2a7a6\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") "
Jul 23 18:02:42.217694 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.217702    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zzlk\" (UniqueName: \"kubernetes.io/projected/d7f15595-aee2-4eac-8012-a74860c2a7a6-kube-api-access-6zzlk\") pod \"d7f15595-aee2-4eac-8012-a74860c2a7a6\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") "
Jul 23 18:02:42.217866 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.217735    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-bundle\") pod \"d7f15595-aee2-4eac-8012-a74860c2a7a6\" (UID: \"d7f15595-aee2-4eac-8012-a74860c2a7a6\") "
Jul 23 18:02:42.218548 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.218525    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-bundle" (OuterVolumeSpecName: "bundle") pod "d7f15595-aee2-4eac-8012-a74860c2a7a6" (UID: "d7f15595-aee2-4eac-8012-a74860c2a7a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:02:42.219766 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.219720    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7f15595-aee2-4eac-8012-a74860c2a7a6-kube-api-access-6zzlk" (OuterVolumeSpecName: "kube-api-access-6zzlk") pod "d7f15595-aee2-4eac-8012-a74860c2a7a6" (UID: "d7f15595-aee2-4eac-8012-a74860c2a7a6"). InnerVolumeSpecName "kube-api-access-6zzlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:02:42.223620 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.223593    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-util" (OuterVolumeSpecName: "util") pod "d7f15595-aee2-4eac-8012-a74860c2a7a6" (UID: "d7f15595-aee2-4eac-8012-a74860c2a7a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:02:42.318632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.318556    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-util\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:02:42.318632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.318586    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zzlk\" (UniqueName: \"kubernetes.io/projected/d7f15595-aee2-4eac-8012-a74860c2a7a6-kube-api-access-6zzlk\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:02:42.318632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:42.318599    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7f15595-aee2-4eac-8012-a74860c2a7a6-bundle\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:02:43.059953 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:43.059882    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv"
Jul 23 18:02:43.059953 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:43.059896    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvrkhv" event={"ID":"d7f15595-aee2-4eac-8012-a74860c2a7a6","Type":"ContainerDied","Data":"5c4038c8844dcc46bbc3b8d9c5610a6c86abeefbfbed65f80cc4f737e0e80022"}
Jul 23 18:02:43.059953 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:43.059937    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c4038c8844dcc46bbc3b8d9c5610a6c86abeefbfbed65f80cc4f737e0e80022"
Jul 23 18:02:51.098727 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.098696    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"]
Jul 23 18:02:51.099114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.098937    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerName="util"
Jul 23 18:02:51.099114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.098948    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerName="util"
Jul 23 18:02:51.099114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.098956    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerName="pull"
Jul 23 18:02:51.099114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.098961    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerName="pull"
Jul 23 18:02:51.099114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.098975    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerName="extract"
Jul 23 18:02:51.099114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.098982    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerName="extract"
Jul 23 18:02:51.099114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.099024    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7f15595-aee2-4eac-8012-a74860c2a7a6" containerName="extract"
Jul 23 18:02:51.101278 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.101260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.106709 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.106677    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 18:02:51.106863 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.106842    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 18:02:51.106947 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.106843    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 18:02:51.107059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.107039    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 18:02:51.107388 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.107139    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z5mhz\""
Jul 23 18:02:51.184634 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.184605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/196057d1-9117-4f15-959e-cf9946f8965b-manifests\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.184634 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.184646    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmjnk\" (UniqueName: \"kubernetes.io/projected/196057d1-9117-4f15-959e-cf9946f8965b-kube-api-access-gmjnk\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.184909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.184670    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/196057d1-9117-4f15-959e-cf9946f8965b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.184909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.184787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/196057d1-9117-4f15-959e-cf9946f8965b-tmp\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.184909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.184829    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/196057d1-9117-4f15-959e-cf9946f8965b-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.186192 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.186170    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"]
Jul 23 18:02:51.285999 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.285974    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/196057d1-9117-4f15-959e-cf9946f8965b-manifests\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.286147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.286014    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmjnk\" (UniqueName: \"kubernetes.io/projected/196057d1-9117-4f15-959e-cf9946f8965b-kube-api-access-gmjnk\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.286147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.286074    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/196057d1-9117-4f15-959e-cf9946f8965b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.286147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.286101    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/196057d1-9117-4f15-959e-cf9946f8965b-tmp\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.286147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.286122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/196057d1-9117-4f15-959e-cf9946f8965b-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.286526 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.286499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/196057d1-9117-4f15-959e-cf9946f8965b-manifests\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.288402 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.288380    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/196057d1-9117-4f15-959e-cf9946f8965b-tmp\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.288492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.288438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/196057d1-9117-4f15-959e-cf9946f8965b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.288529 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.288506    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/196057d1-9117-4f15-959e-cf9946f8965b-webhook-cert\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.298344 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.298317    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmjnk\" (UniqueName: \"kubernetes.io/projected/196057d1-9117-4f15-959e-cf9946f8965b-kube-api-access-gmjnk\") pod \"opendatahub-operator-controller-manager-9f47b6774-b6ggj\" (UID: \"196057d1-9117-4f15-959e-cf9946f8965b\") " pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.410608 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.410525    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:51.557392 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:02:51.557345    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196057d1_9117_4f15_959e_cf9946f8965b.slice/crio-532b2a690a707e7c2b0fa4a7f801a4a0acf40045fdacd74c728c5ee4226869b0 WatchSource:0}: Error finding container 532b2a690a707e7c2b0fa4a7f801a4a0acf40045fdacd74c728c5ee4226869b0: Status 404 returned error can't find the container with id 532b2a690a707e7c2b0fa4a7f801a4a0acf40045fdacd74c728c5ee4226869b0
Jul 23 18:02:51.558457 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.558406    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"]
Jul 23 18:02:51.559298 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:51.559279    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:02:52.094159 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:52.094118    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj" event={"ID":"196057d1-9117-4f15-959e-cf9946f8965b","Type":"ContainerStarted","Data":"532b2a690a707e7c2b0fa4a7f801a4a0acf40045fdacd74c728c5ee4226869b0"}
Jul 23 18:02:56.114316 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:56.114278    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj" event={"ID":"196057d1-9117-4f15-959e-cf9946f8965b","Type":"ContainerStarted","Data":"fd7250607c1b82f94e2c8c0ae9f471c908414735eea230118450b2e9c2f1349a"}
Jul 23 18:02:57.119447 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:57.119415    2572 generic.go:356] "Generic (PLEG): container finished" podID="196057d1-9117-4f15-959e-cf9946f8965b" containerID="fd7250607c1b82f94e2c8c0ae9f471c908414735eea230118450b2e9c2f1349a" exitCode=0
Jul 23 18:02:57.119822 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:57.119506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj" event={"ID":"196057d1-9117-4f15-959e-cf9946f8965b","Type":"ContainerDied","Data":"fd7250607c1b82f94e2c8c0ae9f471c908414735eea230118450b2e9c2f1349a"}
Jul 23 18:02:58.124692 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:58.124653    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj" event={"ID":"196057d1-9117-4f15-959e-cf9946f8965b","Type":"ContainerStarted","Data":"87c0059cb95a2ec05fa738904f3c0e048119a75ce2ed715a9691ad50898750f9"}
Jul 23 18:02:58.125101 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:58.124773    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:02:58.191885 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:02:58.191840    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj" podStartSLOduration=1.6825460859999999 podStartE2EDuration="7.191824752s" totalImagesPullingTime="4.494687366s" totalInitContainerRuntime="1.0145913s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:58.19092484 +0000 UTC m=+320.023616020" watchObservedRunningTime="2026-07-23 18:02:58.191824752 +0000 UTC m=+320.024515909"
Jul 23 18:03:09.131683 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:09.131655    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9f47b6774-b6ggj"
Jul 23 18:03:12.619131 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.619093    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"]
Jul 23 18:03:12.623120 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.623101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.631129 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.631110    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 18:03:12.631293 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.631275    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 18:03:12.631854 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.631841    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 18:03:12.632261 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.632249    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 18:03:12.632607 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.632593    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8d7c4\""
Jul 23 18:03:12.649530 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.649508    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2259831-d1f6-4a85-989d-5470a163a0ca-tls-certs\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.649622 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.649541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkdqk\" (UniqueName: \"kubernetes.io/projected/b2259831-d1f6-4a85-989d-5470a163a0ca-kube-api-access-tkdqk\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.649622 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.649563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2259831-d1f6-4a85-989d-5470a163a0ca-tmp\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.655828 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.655808    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"]
Jul 23 18:03:12.750388 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.750357    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2259831-d1f6-4a85-989d-5470a163a0ca-tls-certs\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.750388 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.750394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkdqk\" (UniqueName: \"kubernetes.io/projected/b2259831-d1f6-4a85-989d-5470a163a0ca-kube-api-access-tkdqk\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.750637 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.750421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2259831-d1f6-4a85-989d-5470a163a0ca-tmp\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.752783 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.752720    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2259831-d1f6-4a85-989d-5470a163a0ca-tmp\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.752964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.752948    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2259831-d1f6-4a85-989d-5470a163a0ca-tls-certs\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.769062 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.769041    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkdqk\" (UniqueName: \"kubernetes.io/projected/b2259831-d1f6-4a85-989d-5470a163a0ca-kube-api-access-tkdqk\") pod \"kube-auth-proxy-cdff8959d-sprmh\" (UID: \"b2259831-d1f6-4a85-989d-5470a163a0ca\") " pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.877086 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.877004    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lnggn"]
Jul 23 18:03:12.879048 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.879032    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:12.883226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.883208    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 18:03:12.884147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.884133    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fmljj\""
Jul 23 18:03:12.910793 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.910767    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lnggn"]
Jul 23 18:03:12.931437 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.931408    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"
Jul 23 18:03:12.951432 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.951404    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p64f\" (UniqueName: \"kubernetes.io/projected/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-kube-api-access-7p64f\") pod \"odh-model-controller-7998c67dc4-lnggn\" (UID: \"d7c5315f-fe3d-47f9-ac74-2f966e1a8221\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:12.951567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:12.951441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-cert\") pod \"odh-model-controller-7998c67dc4-lnggn\" (UID: \"d7c5315f-fe3d-47f9-ac74-2f966e1a8221\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:13.052503 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.052442    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p64f\" (UniqueName: \"kubernetes.io/projected/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-kube-api-access-7p64f\") pod \"odh-model-controller-7998c67dc4-lnggn\" (UID: \"d7c5315f-fe3d-47f9-ac74-2f966e1a8221\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:13.052503 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.052499    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-cert\") pod \"odh-model-controller-7998c67dc4-lnggn\" (UID: \"d7c5315f-fe3d-47f9-ac74-2f966e1a8221\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:13.052696 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:03:13.052600    2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 18:03:13.052696 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:03:13.052670    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-cert podName:d7c5315f-fe3d-47f9-ac74-2f966e1a8221 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:13.552652753 +0000 UTC m=+335.385343892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-cert") pod "odh-model-controller-7998c67dc4-lnggn" (UID: "d7c5315f-fe3d-47f9-ac74-2f966e1a8221") : secret "odh-model-controller-webhook-cert" not found
Jul 23 18:03:13.075939 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.075907    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p64f\" (UniqueName: \"kubernetes.io/projected/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-kube-api-access-7p64f\") pod \"odh-model-controller-7998c67dc4-lnggn\" (UID: \"d7c5315f-fe3d-47f9-ac74-2f966e1a8221\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:13.083198 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.083174    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cdff8959d-sprmh"]
Jul 23 18:03:13.086373 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:03:13.086353    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2259831_d1f6_4a85_989d_5470a163a0ca.slice/crio-c4df5a6200a4860d1f4382668516660638c8720ad688f4e703811198a8daefd1 WatchSource:0}: Error finding container c4df5a6200a4860d1f4382668516660638c8720ad688f4e703811198a8daefd1: Status 404 returned error can't find the container with id c4df5a6200a4860d1f4382668516660638c8720ad688f4e703811198a8daefd1
Jul 23 18:03:13.185714 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.185630    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh" event={"ID":"b2259831-d1f6-4a85-989d-5470a163a0ca","Type":"ContainerStarted","Data":"c4df5a6200a4860d1f4382668516660638c8720ad688f4e703811198a8daefd1"}
Jul 23 18:03:13.556503 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.556467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-cert\") pod \"odh-model-controller-7998c67dc4-lnggn\" (UID: \"d7c5315f-fe3d-47f9-ac74-2f966e1a8221\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:13.558820 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.558790    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7c5315f-fe3d-47f9-ac74-2f966e1a8221-cert\") pod \"odh-model-controller-7998c67dc4-lnggn\" (UID: \"d7c5315f-fe3d-47f9-ac74-2f966e1a8221\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:13.788290 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.788257    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:13.949143 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:13.948897    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lnggn"]
Jul 23 18:03:13.951506 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:03:13.951474    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c5315f_fe3d_47f9_ac74_2f966e1a8221.slice/crio-fc577124de1ffb730e491d52aaecc434bded35e46f9ea9bcee3ef8a0024cf681 WatchSource:0}: Error finding container fc577124de1ffb730e491d52aaecc434bded35e46f9ea9bcee3ef8a0024cf681: Status 404 returned error can't find the container with id fc577124de1ffb730e491d52aaecc434bded35e46f9ea9bcee3ef8a0024cf681
Jul 23 18:03:14.191252 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.191165    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lnggn" event={"ID":"d7c5315f-fe3d-47f9-ac74-2f966e1a8221","Type":"ContainerStarted","Data":"fc577124de1ffb730e491d52aaecc434bded35e46f9ea9bcee3ef8a0024cf681"}
Jul 23 18:03:14.340098 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.340064    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hw74s"]
Jul 23 18:03:14.342110 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.342091    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:14.357837 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.357817    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 23 18:03:14.372080 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.372049    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hw74s"]
Jul 23 18:03:14.465523 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.465438    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efbd195-b8f5-4a3e-a0d9-07542fd97b18-tls-certs\") pod \"model-serving-api-54d89bd5fc-hw74s\" (UID: \"4efbd195-b8f5-4a3e-a0d9-07542fd97b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:14.465523 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.465486    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfrpn\" (UniqueName: \"kubernetes.io/projected/4efbd195-b8f5-4a3e-a0d9-07542fd97b18-kube-api-access-vfrpn\") pod \"model-serving-api-54d89bd5fc-hw74s\" (UID: \"4efbd195-b8f5-4a3e-a0d9-07542fd97b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:14.566139 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.566086    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efbd195-b8f5-4a3e-a0d9-07542fd97b18-tls-certs\") pod \"model-serving-api-54d89bd5fc-hw74s\" (UID: \"4efbd195-b8f5-4a3e-a0d9-07542fd97b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:14.566139 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.566136    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrpn\" (UniqueName: \"kubernetes.io/projected/4efbd195-b8f5-4a3e-a0d9-07542fd97b18-kube-api-access-vfrpn\") pod \"model-serving-api-54d89bd5fc-hw74s\" (UID: \"4efbd195-b8f5-4a3e-a0d9-07542fd97b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:14.568489 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.568463    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efbd195-b8f5-4a3e-a0d9-07542fd97b18-tls-certs\") pod \"model-serving-api-54d89bd5fc-hw74s\" (UID: \"4efbd195-b8f5-4a3e-a0d9-07542fd97b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:14.626080 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.626047    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrpn\" (UniqueName: \"kubernetes.io/projected/4efbd195-b8f5-4a3e-a0d9-07542fd97b18-kube-api-access-vfrpn\") pod \"model-serving-api-54d89bd5fc-hw74s\" (UID: \"4efbd195-b8f5-4a3e-a0d9-07542fd97b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:14.653925 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.653890    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:14.815841 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:14.815807    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hw74s"]
Jul 23 18:03:14.854337 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:03:14.854308    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efbd195_b8f5_4a3e_a0d9_07542fd97b18.slice/crio-f419891df765d62f2eb586bff60ffe7fa9a58e39a54ef4ccaae53ec817f468b0 WatchSource:0}: Error finding container f419891df765d62f2eb586bff60ffe7fa9a58e39a54ef4ccaae53ec817f468b0: Status 404 returned error can't find the container with id f419891df765d62f2eb586bff60ffe7fa9a58e39a54ef4ccaae53ec817f468b0
Jul 23 18:03:15.197765 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:15.197722    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hw74s" event={"ID":"4efbd195-b8f5-4a3e-a0d9-07542fd97b18","Type":"ContainerStarted","Data":"f419891df765d62f2eb586bff60ffe7fa9a58e39a54ef4ccaae53ec817f468b0"}
Jul 23 18:03:16.088533 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.088494    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"]
Jul 23 18:03:16.091062 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.091034    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.103195 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.103172    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 18:03:16.103320 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.103268    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vxbxt\""
Jul 23 18:03:16.107235 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.107216    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 18:03:16.107491 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.107473    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 18:03:16.112366 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.112350    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 18:03:16.130926 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.130879    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"]
Jul 23 18:03:16.181229 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.181187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-cacerts\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.181391 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.181247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-token\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.181391 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.181331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5d888d-5006-4e5e-a8af-b0610456f5a4-local-certs\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.181516 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.181403    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.181516 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.181474    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.181623 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.181520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.181623 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.181555    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6856w\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-kube-api-access-6856w\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.282814 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.282776    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5d888d-5006-4e5e-a8af-b0610456f5a4-local-certs\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.282997 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.282854    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.282997 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.282898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.282997 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.282935    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.282997 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.282969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6856w\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-kube-api-access-6856w\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.283788 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.283003    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-cacerts\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.283788 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.283032    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-token\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.283907 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.283795    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.285954 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.285916    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5d888d-5006-4e5e-a8af-b0610456f5a4-local-certs\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.286626 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.286599    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-cacerts\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.286831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.286806    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.287340 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.287312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.296687 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.296651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6856w\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-kube-api-access-6856w\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.296840 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.296739    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-token\") pod \"istiod-openshift-gateway-7574459656-cxqc2\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:16.403742 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:16.403627    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:17.814634 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:17.814562    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"]
Jul 23 18:03:18.042257 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:03:18.042223    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5d888d_5006_4e5e_a8af_b0610456f5a4.slice/crio-46f86d084ea1c2c8aedeb02ff7d9af0bfcb1f267ee41000e5838e0a9c5ced2c5 WatchSource:0}: Error finding container 46f86d084ea1c2c8aedeb02ff7d9af0bfcb1f267ee41000e5838e0a9c5ced2c5: Status 404 returned error can't find the container with id 46f86d084ea1c2c8aedeb02ff7d9af0bfcb1f267ee41000e5838e0a9c5ced2c5
Jul 23 18:03:18.212707 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.212673    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hw74s" event={"ID":"4efbd195-b8f5-4a3e-a0d9-07542fd97b18","Type":"ContainerStarted","Data":"cbb0e79182bf486d0f7155527e9005b5f1b09cb3e1311a3008bb17c041a24f3c"}
Jul 23 18:03:18.212901 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.212784    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:18.214144 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.214118    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh" event={"ID":"b2259831-d1f6-4a85-989d-5470a163a0ca","Type":"ContainerStarted","Data":"3b4e65250c873b09886cd929fc6c067e78cdc198a29095457dec6c517955556a"}
Jul 23 18:03:18.215610 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.215586    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lnggn" event={"ID":"d7c5315f-fe3d-47f9-ac74-2f966e1a8221","Type":"ContainerStarted","Data":"b8101c481b926e18db49570b2914400458bca75a07209b46fdacb145d093e840"}
Jul 23 18:03:18.215688 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.215661    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:18.216721 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.216701    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2" event={"ID":"ee5d888d-5006-4e5e-a8af-b0610456f5a4","Type":"ContainerStarted","Data":"46f86d084ea1c2c8aedeb02ff7d9af0bfcb1f267ee41000e5838e0a9c5ced2c5"}
Jul 23 18:03:18.243946 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.243904    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hw74s" podStartSLOduration=1.033151418 podStartE2EDuration="4.243892249s" totalImagesPullingTime="3.210740831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:18.242978793 +0000 UTC m=+340.075669955" watchObservedRunningTime="2026-07-23 18:03:18.243892249 +0000 UTC m=+340.076583440"
Jul 23 18:03:18.274342 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.274301    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lnggn" podStartSLOduration=2.163677861 podStartE2EDuration="6.274287599s" totalImagesPullingTime="4.110609738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:18.27350874 +0000 UTC m=+340.106199917" watchObservedRunningTime="2026-07-23 18:03:18.274287599 +0000 UTC m=+340.106978757"
Jul 23 18:03:18.292563 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:18.292490    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cdff8959d-sprmh" podStartSLOduration=1.3380356789999999 podStartE2EDuration="6.292479394s" totalImagesPullingTime="4.954443715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:18.291788348 +0000 UTC m=+340.124479528" watchObservedRunningTime="2026-07-23 18:03:18.292479394 +0000 UTC m=+340.125170584"
Jul 23 18:03:24.930705 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:24.930663    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:03:24.931044 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:24.930739    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:03:25.248488 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.248399    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2" event={"ID":"ee5d888d-5006-4e5e-a8af-b0610456f5a4","Type":"ContainerStarted","Data":"496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3"}
Jul 23 18:03:25.248651 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.248592    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:25.249880 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.249854    2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cxqc2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:03:25.250010 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.249898    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2" podUID="ee5d888d-5006-4e5e-a8af-b0610456f5a4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:03:25.342880 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.342835    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2" podStartSLOduration=2.456903231 podStartE2EDuration="9.342821366s" totalImagesPullingTime="6.885918135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:25.341545299 +0000 UTC m=+347.174236457" watchObservedRunningTime="2026-07-23 18:03:25.342821366 +0000 UTC m=+347.175512523"
Jul 23 18:03:25.775487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.775456    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9x584"]
Jul 23 18:03:25.783339 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.783297    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"]
Jul 23 18:03:25.783507 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.783432    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:25.786259 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.786240    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:25.787033 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.786936    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 18:03:25.787348 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.787330    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-952hk\""
Jul 23 18:03:25.788916 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.788884    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hz5mw\""
Jul 23 18:03:25.789857 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.789841    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 18:03:25.804394 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.804371    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"]
Jul 23 18:03:25.805963 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.805942    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9x584"]
Jul 23 18:03:25.866971 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.866931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k527w\" (UniqueName: \"kubernetes.io/projected/7092cf85-0a32-4bb4-b441-a60885bc92d4-kube-api-access-k527w\") pod \"llmisvc-controller-manager-777c6bd7d5-s2qqn\" (UID: \"7092cf85-0a32-4bb4-b441-a60885bc92d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:25.866971 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.866976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7092cf85-0a32-4bb4-b441-a60885bc92d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s2qqn\" (UID: \"7092cf85-0a32-4bb4-b441-a60885bc92d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:25.867188 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.867145    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfa4145-d2ab-4b01-afbe-73dcb95cff70-cert\") pod \"kserve-controller-manager-d6f4b65b8-9x584\" (UID: \"fdfa4145-d2ab-4b01-afbe-73dcb95cff70\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:25.867188 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.867180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vml54\" (UniqueName: \"kubernetes.io/projected/fdfa4145-d2ab-4b01-afbe-73dcb95cff70-kube-api-access-vml54\") pod \"kserve-controller-manager-d6f4b65b8-9x584\" (UID: \"fdfa4145-d2ab-4b01-afbe-73dcb95cff70\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:25.968330 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.968298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vml54\" (UniqueName: \"kubernetes.io/projected/fdfa4145-d2ab-4b01-afbe-73dcb95cff70-kube-api-access-vml54\") pod \"kserve-controller-manager-d6f4b65b8-9x584\" (UID: \"fdfa4145-d2ab-4b01-afbe-73dcb95cff70\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:25.968706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.968340    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k527w\" (UniqueName: \"kubernetes.io/projected/7092cf85-0a32-4bb4-b441-a60885bc92d4-kube-api-access-k527w\") pod \"llmisvc-controller-manager-777c6bd7d5-s2qqn\" (UID: \"7092cf85-0a32-4bb4-b441-a60885bc92d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:25.968706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.968358    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7092cf85-0a32-4bb4-b441-a60885bc92d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s2qqn\" (UID: \"7092cf85-0a32-4bb4-b441-a60885bc92d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:25.968706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.968551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfa4145-d2ab-4b01-afbe-73dcb95cff70-cert\") pod \"kserve-controller-manager-d6f4b65b8-9x584\" (UID: \"fdfa4145-d2ab-4b01-afbe-73dcb95cff70\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:25.970855 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.970833    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7092cf85-0a32-4bb4-b441-a60885bc92d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s2qqn\" (UID: \"7092cf85-0a32-4bb4-b441-a60885bc92d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:25.970855 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.970849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfa4145-d2ab-4b01-afbe-73dcb95cff70-cert\") pod \"kserve-controller-manager-d6f4b65b8-9x584\" (UID: \"fdfa4145-d2ab-4b01-afbe-73dcb95cff70\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:25.987728 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.987704    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vml54\" (UniqueName: \"kubernetes.io/projected/fdfa4145-d2ab-4b01-afbe-73dcb95cff70-kube-api-access-vml54\") pod \"kserve-controller-manager-d6f4b65b8-9x584\" (UID: \"fdfa4145-d2ab-4b01-afbe-73dcb95cff70\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:25.990433 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:25.990410    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k527w\" (UniqueName: \"kubernetes.io/projected/7092cf85-0a32-4bb4-b441-a60885bc92d4-kube-api-access-k527w\") pod \"llmisvc-controller-manager-777c6bd7d5-s2qqn\" (UID: \"7092cf85-0a32-4bb4-b441-a60885bc92d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:26.105309 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:26.105238    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:26.114385 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:26.114361    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:26.257369 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:26.257263    2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cxqc2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:03:26.257369 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:26.257321    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2" podUID="ee5d888d-5006-4e5e-a8af-b0610456f5a4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:03:26.349082 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:26.349053    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9x584"]
Jul 23 18:03:26.350574 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:03:26.350543    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfa4145_d2ab_4b01_afbe_73dcb95cff70.slice/crio-bb4803e9b8ecaa34b0ecf43f398c7e245dda53c6897a305c743ba1613f5f4eae WatchSource:0}: Error finding container bb4803e9b8ecaa34b0ecf43f398c7e245dda53c6897a305c743ba1613f5f4eae: Status 404 returned error can't find the container with id bb4803e9b8ecaa34b0ecf43f398c7e245dda53c6897a305c743ba1613f5f4eae
Jul 23 18:03:26.393721 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:26.393657    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"]
Jul 23 18:03:26.404019 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:03:26.403997    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7092cf85_0a32_4bb4_b441_a60885bc92d4.slice/crio-b99090592dbf5071c5454368a6602ebe7551188ca49a21e09c67eeef7d40ce9d WatchSource:0}: Error finding container b99090592dbf5071c5454368a6602ebe7551188ca49a21e09c67eeef7d40ce9d: Status 404 returned error can't find the container with id b99090592dbf5071c5454368a6602ebe7551188ca49a21e09c67eeef7d40ce9d
Jul 23 18:03:27.260368 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.260330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn" event={"ID":"7092cf85-0a32-4bb4-b441-a60885bc92d4","Type":"ContainerStarted","Data":"b99090592dbf5071c5454368a6602ebe7551188ca49a21e09c67eeef7d40ce9d"}
Jul 23 18:03:27.261706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.261680    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584" event={"ID":"fdfa4145-d2ab-4b01-afbe-73dcb95cff70","Type":"ContainerStarted","Data":"bb4803e9b8ecaa34b0ecf43f398c7e245dda53c6897a305c743ba1613f5f4eae"}
Jul 23 18:03:27.672170 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.672128    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"]
Jul 23 18:03:27.675796 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.675773    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.680188 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.680160    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-shkkz\""
Jul 23 18:03:27.743627 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.743479    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"]
Jul 23 18:03:27.786219 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.786442 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bkv2\" (UniqueName: \"kubernetes.io/projected/0b56ec11-5be8-4469-b017-af0a2c618009-kube-api-access-9bkv2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.786442 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.786442 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.786442 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.786700 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786506    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b56ec11-5be8-4469-b017-af0a2c618009-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.786700 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786585    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.786700 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786612    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b56ec11-5be8-4469-b017-af0a2c618009-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.786700 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.786641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b56ec11-5be8-4469-b017-af0a2c618009-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.887979 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.887933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.887979 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.887983    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b56ec11-5be8-4469-b017-af0a2c618009-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.888208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.888012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b56ec11-5be8-4469-b017-af0a2c618009-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.888208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.888054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.888208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.888083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bkv2\" (UniqueName: \"kubernetes.io/projected/0b56ec11-5be8-4469-b017-af0a2c618009-kube-api-access-9bkv2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.888208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.888120    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.888208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.888169    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.888208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.888203    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.888572 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.888261    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b56ec11-5be8-4469-b017-af0a2c618009-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.889550 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.889134    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.889550 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.889168    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.889550 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.889494    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.889829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.889604    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.889988 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.889964    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b56ec11-5be8-4469-b017-af0a2c618009-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.891277 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.891225    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b56ec11-5be8-4469-b017-af0a2c618009-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.891612 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.891576    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b56ec11-5be8-4469-b017-af0a2c618009-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.903942 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.903894    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b56ec11-5be8-4469-b017-af0a2c618009-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.907978 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.907952    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bkv2\" (UniqueName: \"kubernetes.io/projected/0b56ec11-5be8-4469-b017-af0a2c618009-kube-api-access-9bkv2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mg8rx\" (UID: \"0b56ec11-5be8-4469-b017-af0a2c618009\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:27.988812 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:27.988722    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:28.167024 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:28.166997    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"]
Jul 23 18:03:28.169742 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:03:28.169705    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b56ec11_5be8_4469_b017_af0a2c618009.slice/crio-fcbf338bc5cc2baf10fbbfd3138f0ada17ee9852541d36cc4366b0afe2cb1265 WatchSource:0}: Error finding container fcbf338bc5cc2baf10fbbfd3138f0ada17ee9852541d36cc4366b0afe2cb1265: Status 404 returned error can't find the container with id fcbf338bc5cc2baf10fbbfd3138f0ada17ee9852541d36cc4366b0afe2cb1265
Jul 23 18:03:28.268106 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:28.268071    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx" event={"ID":"0b56ec11-5be8-4469-b017-af0a2c618009","Type":"ContainerStarted","Data":"fcbf338bc5cc2baf10fbbfd3138f0ada17ee9852541d36cc4366b0afe2cb1265"}
Jul 23 18:03:28.952604 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:28.952568    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"]
Jul 23 18:03:28.952832 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:28.952803    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2" podUID="ee5d888d-5006-4e5e-a8af-b0610456f5a4" containerName="discovery" containerID="cri-o://496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3" gracePeriod=30
Jul 23 18:03:28.953546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:28.953525    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:29.223850 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.223743    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lnggn"
Jul 23 18:03:29.226356 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.226332    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hw74s"
Jul 23 18:03:29.511093 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.511067    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:29.605644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.605616    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5d888d-5006-4e5e-a8af-b0610456f5a4-local-certs\") pod \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") "
Jul 23 18:03:29.605823 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.605667    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-cacerts\") pod \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") "
Jul 23 18:03:29.605823 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.605723    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6856w\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-kube-api-access-6856w\") pod \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") "
Jul 23 18:03:29.605823 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.605788    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-token\") pod \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") "
Jul 23 18:03:29.605988 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.605827    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-kubeconfig\") pod \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") "
Jul 23 18:03:29.605988 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.605852    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-dns-cert\") pod \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") "
Jul 23 18:03:29.605988 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.605892    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-ca-configmap\") pod \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\" (UID: \"ee5d888d-5006-4e5e-a8af-b0610456f5a4\") "
Jul 23 18:03:29.606520 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.606471    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ee5d888d-5006-4e5e-a8af-b0610456f5a4" (UID: "ee5d888d-5006-4e5e-a8af-b0610456f5a4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:03:29.608371 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.608341    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-cacerts" (OuterVolumeSpecName: "cacerts") pod "ee5d888d-5006-4e5e-a8af-b0610456f5a4" (UID: "ee5d888d-5006-4e5e-a8af-b0610456f5a4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:03:29.608491 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.608364    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ee5d888d-5006-4e5e-a8af-b0610456f5a4" (UID: "ee5d888d-5006-4e5e-a8af-b0610456f5a4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:03:29.608491 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.608464    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5d888d-5006-4e5e-a8af-b0610456f5a4-local-certs" (OuterVolumeSpecName: "local-certs") pod "ee5d888d-5006-4e5e-a8af-b0610456f5a4" (UID: "ee5d888d-5006-4e5e-a8af-b0610456f5a4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:03:29.608623 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.608485    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-kube-api-access-6856w" (OuterVolumeSpecName: "kube-api-access-6856w") pod "ee5d888d-5006-4e5e-a8af-b0610456f5a4" (UID: "ee5d888d-5006-4e5e-a8af-b0610456f5a4"). InnerVolumeSpecName "kube-api-access-6856w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:03:29.608623 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.608592    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee5d888d-5006-4e5e-a8af-b0610456f5a4" (UID: "ee5d888d-5006-4e5e-a8af-b0610456f5a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:03:29.608787 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.608744    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ee5d888d-5006-4e5e-a8af-b0610456f5a4" (UID: "ee5d888d-5006-4e5e-a8af-b0610456f5a4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:03:29.707045 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.707014    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-ca-configmap\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:03:29.707045 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.707047    2572 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee5d888d-5006-4e5e-a8af-b0610456f5a4-local-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:03:29.707249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.707064    2572 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-cacerts\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:03:29.707249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.707076    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6856w\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-kube-api-access-6856w\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:03:29.707249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.707088    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:03:29.707249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.707096    2572 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-kubeconfig\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:03:29.707249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:29.707104    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ee5d888d-5006-4e5e-a8af-b0610456f5a4-istio-csr-dns-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:03:30.280471 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.280431    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn" event={"ID":"7092cf85-0a32-4bb4-b441-a60885bc92d4","Type":"ContainerStarted","Data":"a9cf0a544cb711ded39accdaf53c83f5bd09509c635453ec58bdfca95664be8d"}
Jul 23 18:03:30.280659 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.280525    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:03:30.282332 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.282271    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584" event={"ID":"fdfa4145-d2ab-4b01-afbe-73dcb95cff70","Type":"ContainerStarted","Data":"9721920707e27c134af0dec6d517f0abcb413a307ea1f21eb31f5b6a8aeb3d23"}
Jul 23 18:03:30.282463 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.282372    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:03:30.283642 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.283618    2572 generic.go:356] "Generic (PLEG): container finished" podID="ee5d888d-5006-4e5e-a8af-b0610456f5a4" containerID="496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3" exitCode=0
Jul 23 18:03:30.283778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.283650    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2" event={"ID":"ee5d888d-5006-4e5e-a8af-b0610456f5a4","Type":"ContainerDied","Data":"496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3"}
Jul 23 18:03:30.283778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.283674    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"
Jul 23 18:03:30.283778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.283686    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2" event={"ID":"ee5d888d-5006-4e5e-a8af-b0610456f5a4","Type":"ContainerDied","Data":"46f86d084ea1c2c8aedeb02ff7d9af0bfcb1f267ee41000e5838e0a9c5ced2c5"}
Jul 23 18:03:30.283778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.283714    2572 scope.go:117] "RemoveContainer" containerID="496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3"
Jul 23 18:03:30.294256 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.294233    2572 scope.go:117] "RemoveContainer" containerID="496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3"
Jul 23 18:03:30.294526 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:03:30.294495    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3\": container with ID starting with 496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3 not found: ID does not exist" containerID="496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3"
Jul 23 18:03:30.294588 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.294534    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3"} err="failed to get container status \"496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3\": rpc error: code = NotFound desc = could not find container \"496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3\": container with ID starting with 496c2342922cc9a700197bc96266d356ca51762e124a1d86789b56e248daddd3 not found: ID does not exist"
Jul 23 18:03:30.357616 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.357562    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn" podStartSLOduration=2.354624627 podStartE2EDuration="5.357547391s" totalImagesPullingTime="3.002922764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:30.326874284 +0000 UTC m=+352.159565455" watchObservedRunningTime="2026-07-23 18:03:30.357547391 +0000 UTC m=+352.190238601"
Jul 23 18:03:30.357945 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.357907    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"]
Jul 23 18:03:30.382383 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.382358    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cxqc2"]
Jul 23 18:03:30.447445 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.447390    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584" podStartSLOduration=2.433027438 podStartE2EDuration="5.447373443s" totalImagesPullingTime="3.014346005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:30.446098406 +0000 UTC m=+352.278789566" watchObservedRunningTime="2026-07-23 18:03:30.447373443 +0000 UTC m=+352.280064600"
Jul 23 18:03:30.792765 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:30.792725    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5d888d-5006-4e5e-a8af-b0610456f5a4" path="/var/lib/kubelet/pods/ee5d888d-5006-4e5e-a8af-b0610456f5a4/volumes"
Jul 23 18:03:31.323440 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:31.323405    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:03:31.323546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:31.323471    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:03:31.323546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:31.323523    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:03:32.295463 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:32.295430    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx" event={"ID":"0b56ec11-5be8-4469-b017-af0a2c618009","Type":"ContainerStarted","Data":"fb24b4e35267741d55a9d7036eebfa6ceb64b9d5b9060791507a5dd5d272270f"}
Jul 23 18:03:32.383159 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:32.383115    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx" podStartSLOduration=2.232107401 podStartE2EDuration="5.383101821s" totalImagesPullingTime="3.15099442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:32.381716887 +0000 UTC m=+354.214408065" watchObservedRunningTime="2026-07-23 18:03:32.383101821 +0000 UTC m=+354.215793046"
Jul 23 18:03:32.989550 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:32.989515    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:32.994099 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:32.994073    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:33.299835 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:33.299806    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:03:33.300830 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:03:33.300807    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mg8rx"
Jul 23 18:04:01.292061 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:01.292030    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s2qqn"
Jul 23 18:04:01.295156 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:01.295137    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9x584"
Jul 23 18:04:13.667494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.667450    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mhbwc"]
Jul 23 18:04:13.667990 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.667896    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5d888d-5006-4e5e-a8af-b0610456f5a4" containerName="discovery"
Jul 23 18:04:13.667990 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.667914    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5d888d-5006-4e5e-a8af-b0610456f5a4" containerName="discovery"
Jul 23 18:04:13.668167 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.668004    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5d888d-5006-4e5e-a8af-b0610456f5a4" containerName="discovery"
Jul 23 18:04:13.674906 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.674882    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc"
Jul 23 18:04:13.677959 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.677937    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-p6ppj\""
Jul 23 18:04:13.678212 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.678194    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 18:04:13.679006 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.678959    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 18:04:13.684731 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.684706    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mhbwc"]
Jul 23 18:04:13.749170 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.749133    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgwdx\" (UniqueName: \"kubernetes.io/projected/08e84b99-3e7b-45cb-b664-c9e0706aa8f4-kube-api-access-hgwdx\") pod \"kuadrant-operator-catalog-mhbwc\" (UID: \"08e84b99-3e7b-45cb-b664-c9e0706aa8f4\") " pod="kuadrant-system/kuadrant-operator-catalog-mhbwc"
Jul 23 18:04:13.850130 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.850093    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgwdx\" (UniqueName: \"kubernetes.io/projected/08e84b99-3e7b-45cb-b664-c9e0706aa8f4-kube-api-access-hgwdx\") pod \"kuadrant-operator-catalog-mhbwc\" (UID: \"08e84b99-3e7b-45cb-b664-c9e0706aa8f4\") " pod="kuadrant-system/kuadrant-operator-catalog-mhbwc"
Jul 23 18:04:13.864601 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.864570    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgwdx\" (UniqueName: \"kubernetes.io/projected/08e84b99-3e7b-45cb-b664-c9e0706aa8f4-kube-api-access-hgwdx\") pod \"kuadrant-operator-catalog-mhbwc\" (UID: \"08e84b99-3e7b-45cb-b664-c9e0706aa8f4\") " pod="kuadrant-system/kuadrant-operator-catalog-mhbwc"
Jul 23 18:04:13.986034 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:13.985952    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc"
Jul 23 18:04:14.018463 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.018432    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mhbwc"]
Jul 23 18:04:14.113683 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.113655    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mhbwc"]
Jul 23 18:04:14.117061 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:14.116858    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e84b99_3e7b_45cb_b664_c9e0706aa8f4.slice/crio-19c313edb213f1417014edeeab02a2b25faf2f192cf30a82737f0494550de150 WatchSource:0}: Error finding container 19c313edb213f1417014edeeab02a2b25faf2f192cf30a82737f0494550de150: Status 404 returned error can't find the container with id 19c313edb213f1417014edeeab02a2b25faf2f192cf30a82737f0494550de150
Jul 23 18:04:14.225156 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.225122    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktvqw"]
Jul 23 18:04:14.229212 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.229193    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:14.242212 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.242156    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktvqw"]
Jul 23 18:04:14.353952 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.353919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw447\" (UniqueName: \"kubernetes.io/projected/21c46fda-8c06-454a-9b08-e57f7d728554-kube-api-access-cw447\") pod \"kuadrant-operator-catalog-ktvqw\" (UID: \"21c46fda-8c06-454a-9b08-e57f7d728554\") " pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:14.454314 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.454272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw447\" (UniqueName: \"kubernetes.io/projected/21c46fda-8c06-454a-9b08-e57f7d728554-kube-api-access-cw447\") pod \"kuadrant-operator-catalog-ktvqw\" (UID: \"21c46fda-8c06-454a-9b08-e57f7d728554\") " pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:14.464178 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.464157    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw447\" (UniqueName: \"kubernetes.io/projected/21c46fda-8c06-454a-9b08-e57f7d728554-kube-api-access-cw447\") pod \"kuadrant-operator-catalog-ktvqw\" (UID: \"21c46fda-8c06-454a-9b08-e57f7d728554\") " pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:14.470107 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.470073    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc" event={"ID":"08e84b99-3e7b-45cb-b664-c9e0706aa8f4","Type":"ContainerStarted","Data":"19c313edb213f1417014edeeab02a2b25faf2f192cf30a82737f0494550de150"}
Jul 23 18:04:14.538287 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.538238    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:14.676628 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:14.676598    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktvqw"]
Jul 23 18:04:14.678500 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:14.678472    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c46fda_8c06_454a_9b08_e57f7d728554.slice/crio-e76f6cf3554858115f5854a0a173f6bff9905c50b4f1540cdf53c469b32158d0 WatchSource:0}: Error finding container e76f6cf3554858115f5854a0a173f6bff9905c50b4f1540cdf53c469b32158d0: Status 404 returned error can't find the container with id e76f6cf3554858115f5854a0a173f6bff9905c50b4f1540cdf53c469b32158d0
Jul 23 18:04:15.478858 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:15.478815    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw" event={"ID":"21c46fda-8c06-454a-9b08-e57f7d728554","Type":"ContainerStarted","Data":"e76f6cf3554858115f5854a0a173f6bff9905c50b4f1540cdf53c469b32158d0"}
Jul 23 18:04:16.485326 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.485281    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc" event={"ID":"08e84b99-3e7b-45cb-b664-c9e0706aa8f4","Type":"ContainerStarted","Data":"0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f"}
Jul 23 18:04:16.485326 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.485306    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc" podUID="08e84b99-3e7b-45cb-b664-c9e0706aa8f4" containerName="registry-server" containerID="cri-o://0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f" gracePeriod=2
Jul 23 18:04:16.486885 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.486859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw" event={"ID":"21c46fda-8c06-454a-9b08-e57f7d728554","Type":"ContainerStarted","Data":"addae07ef724c3058824e27dbcfb631d54500df03b7d62da6a0f8c940f7455d8"}
Jul 23 18:04:16.506884 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.506836    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc" podStartSLOduration=1.322585141 podStartE2EDuration="3.506820642s" totalImagesPullingTime="2.184235501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:16.504400051 +0000 UTC m=+398.337091208" watchObservedRunningTime="2026-07-23 18:04:16.506820642 +0000 UTC m=+398.339511799"
Jul 23 18:04:16.523896 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.523858    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw" podStartSLOduration=0.896961344 podStartE2EDuration="2.523844385s" totalImagesPullingTime="1.626883041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:16.5222522 +0000 UTC m=+398.354943388" watchObservedRunningTime="2026-07-23 18:04:16.523844385 +0000 UTC m=+398.356535544"
Jul 23 18:04:16.723737 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.723708    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc"
Jul 23 18:04:16.776287 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.776261    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgwdx\" (UniqueName: \"kubernetes.io/projected/08e84b99-3e7b-45cb-b664-c9e0706aa8f4-kube-api-access-hgwdx\") pod \"08e84b99-3e7b-45cb-b664-c9e0706aa8f4\" (UID: \"08e84b99-3e7b-45cb-b664-c9e0706aa8f4\") "
Jul 23 18:04:16.778313 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.778281    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08e84b99-3e7b-45cb-b664-c9e0706aa8f4-kube-api-access-hgwdx" (OuterVolumeSpecName: "kube-api-access-hgwdx") pod "08e84b99-3e7b-45cb-b664-c9e0706aa8f4" (UID: "08e84b99-3e7b-45cb-b664-c9e0706aa8f4"). InnerVolumeSpecName "kube-api-access-hgwdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:16.877027 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:16.876929    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgwdx\" (UniqueName: \"kubernetes.io/projected/08e84b99-3e7b-45cb-b664-c9e0706aa8f4-kube-api-access-hgwdx\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:17.492603 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.492567    2572 generic.go:356] "Generic (PLEG): container finished" podID="08e84b99-3e7b-45cb-b664-c9e0706aa8f4" containerID="0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f" exitCode=0
Jul 23 18:04:17.493030 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.492624    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc"
Jul 23 18:04:17.493030 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.492651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc" event={"ID":"08e84b99-3e7b-45cb-b664-c9e0706aa8f4","Type":"ContainerDied","Data":"0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f"}
Jul 23 18:04:17.493030 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.492728    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mhbwc" event={"ID":"08e84b99-3e7b-45cb-b664-c9e0706aa8f4","Type":"ContainerDied","Data":"19c313edb213f1417014edeeab02a2b25faf2f192cf30a82737f0494550de150"}
Jul 23 18:04:17.493030 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.492772    2572 scope.go:117] "RemoveContainer" containerID="0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f"
Jul 23 18:04:17.501425 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.501402    2572 scope.go:117] "RemoveContainer" containerID="0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f"
Jul 23 18:04:17.501721 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:04:17.501701    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f\": container with ID starting with 0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f not found: ID does not exist" containerID="0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f"
Jul 23 18:04:17.501787 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.501730    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f"} err="failed to get container status \"0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f\": rpc error: code = NotFound desc = could not find container \"0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f\": container with ID starting with 0a856a1d921de96d5065b5e8db8c556caed6d37e81b30079e9be2930e943f08f not found: ID does not exist"
Jul 23 18:04:17.510314 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.510285    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mhbwc"]
Jul 23 18:04:17.512318 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:17.512294    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mhbwc"]
Jul 23 18:04:18.792641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:18.792607    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08e84b99-3e7b-45cb-b664-c9e0706aa8f4" path="/var/lib/kubelet/pods/08e84b99-3e7b-45cb-b664-c9e0706aa8f4/volumes"
Jul 23 18:04:24.538641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:24.538610    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:24.539066 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:24.538892    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:24.560937 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:24.560913    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:25.548518 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:25.548493    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ktvqw"
Jul 23 18:04:29.363125 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.363089    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"]
Jul 23 18:04:29.363497 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.363399    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08e84b99-3e7b-45cb-b664-c9e0706aa8f4" containerName="registry-server"
Jul 23 18:04:29.363497 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.363410    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="08e84b99-3e7b-45cb-b664-c9e0706aa8f4" containerName="registry-server"
Jul 23 18:04:29.363497 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.363468    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="08e84b99-3e7b-45cb-b664-c9e0706aa8f4" containerName="registry-server"
Jul 23 18:04:29.367895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.367878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.385270 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.385251    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2dhdm\""
Jul 23 18:04:29.398159 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.398135    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"]
Jul 23 18:04:29.479183 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.479150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlczh\" (UniqueName: \"kubernetes.io/projected/e9d93db6-c396-43fa-b155-5ace5f39e57e-kube-api-access-qlczh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.479293 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.479191    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.479293 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.479269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.579772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.579713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlczh\" (UniqueName: \"kubernetes.io/projected/e9d93db6-c396-43fa-b155-5ace5f39e57e-kube-api-access-qlczh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.579772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.579777    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.579985 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.579825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.580149 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.580131    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.580184 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.580155    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.589602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.589581    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlczh\" (UniqueName: \"kubernetes.io/projected/e9d93db6-c396-43fa-b155-5ace5f39e57e-kube-api-access-qlczh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.676256 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.676169    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:29.688392 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.688366    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"]
Jul 23 18:04:29.693079 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.693059    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.706605 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.706578    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"]
Jul 23 18:04:29.781445 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.781410    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.781607 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.781466    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tsm\" (UniqueName: \"kubernetes.io/projected/36469446-5487-400d-8b15-1008c0e8e63b-kube-api-access-z4tsm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.781607 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.781506    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.820114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.820089    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"]
Jul 23 18:04:29.821679 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:29.821651    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d93db6_c396_43fa_b155_5ace5f39e57e.slice/crio-f89f8b85836a4be4ffc404c28a782dc615cddee4fee15fe94de307b606cd98bf WatchSource:0}: Error finding container f89f8b85836a4be4ffc404c28a782dc615cddee4fee15fe94de307b606cd98bf: Status 404 returned error can't find the container with id f89f8b85836a4be4ffc404c28a782dc615cddee4fee15fe94de307b606cd98bf
Jul 23 18:04:29.882112 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.882091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.882199 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.882181    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.882239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.882210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tsm\" (UniqueName: \"kubernetes.io/projected/36469446-5487-400d-8b15-1008c0e8e63b-kube-api-access-z4tsm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.882519 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.882497    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.882561 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.882515    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:29.891211 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:29.891190    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tsm\" (UniqueName: \"kubernetes.io/projected/36469446-5487-400d-8b15-1008c0e8e63b-kube-api-access-z4tsm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:30.008535 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.008473    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:30.090513 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.090485    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"]
Jul 23 18:04:30.095178 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.095152    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.112536 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.112509    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"]
Jul 23 18:04:30.141576 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.141556    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"]
Jul 23 18:04:30.143151 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:30.143125    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36469446_5487_400d_8b15_1008c0e8e63b.slice/crio-fe6969377f56c3ee779bf7d8e6a2b5c1bda59f0a95f09aa08c6b2c5467b625c4 WatchSource:0}: Error finding container fe6969377f56c3ee779bf7d8e6a2b5c1bda59f0a95f09aa08c6b2c5467b625c4: Status 404 returned error can't find the container with id fe6969377f56c3ee779bf7d8e6a2b5c1bda59f0a95f09aa08c6b2c5467b625c4
Jul 23 18:04:30.184565 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.184542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2ld\" (UniqueName: \"kubernetes.io/projected/02eeafca-9104-4da9-949d-32b27607df69-kube-api-access-wp2ld\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.184669 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.184577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.184833 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.184677    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.285826 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.285799    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.285935 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.285856    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2ld\" (UniqueName: \"kubernetes.io/projected/02eeafca-9104-4da9-949d-32b27607df69-kube-api-access-wp2ld\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.285935 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.285883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.286206 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.286184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.286261 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.286211    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.295034 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.295009    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2ld\" (UniqueName: \"kubernetes.io/projected/02eeafca-9104-4da9-949d-32b27607df69-kube-api-access-wp2ld\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.404620 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.404598    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:30.480278 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.480250    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"]
Jul 23 18:04:30.484651 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.484628    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.494546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.494520    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"]
Jul 23 18:04:30.538315 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.538253    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"]
Jul 23 18:04:30.541069 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:30.541037    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02eeafca_9104_4da9_949d_32b27607df69.slice/crio-7f82538db2d6a4b9f5b2562bb2e1ad9ecd874d37e00d24af782f011c417023f6 WatchSource:0}: Error finding container 7f82538db2d6a4b9f5b2562bb2e1ad9ecd874d37e00d24af782f011c417023f6: Status 404 returned error can't find the container with id 7f82538db2d6a4b9f5b2562bb2e1ad9ecd874d37e00d24af782f011c417023f6
Jul 23 18:04:30.550544 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.550522    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s" event={"ID":"02eeafca-9104-4da9-949d-32b27607df69","Type":"ContainerStarted","Data":"7f82538db2d6a4b9f5b2562bb2e1ad9ecd874d37e00d24af782f011c417023f6"}
Jul 23 18:04:30.551993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.551970    2572 generic.go:356] "Generic (PLEG): container finished" podID="36469446-5487-400d-8b15-1008c0e8e63b" containerID="9721652ea37ea0569e8cb13e435b8321655c0cd8502b9aa9355aed083aeb5600" exitCode=0
Jul 23 18:04:30.552090 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.552046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4" event={"ID":"36469446-5487-400d-8b15-1008c0e8e63b","Type":"ContainerDied","Data":"9721652ea37ea0569e8cb13e435b8321655c0cd8502b9aa9355aed083aeb5600"}
Jul 23 18:04:30.552090 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.552080    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4" event={"ID":"36469446-5487-400d-8b15-1008c0e8e63b","Type":"ContainerStarted","Data":"fe6969377f56c3ee779bf7d8e6a2b5c1bda59f0a95f09aa08c6b2c5467b625c4"}
Jul 23 18:04:30.553574 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.553553    2572 generic.go:356] "Generic (PLEG): container finished" podID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerID="f278dfcebfcfcbfb64d78fbb666669054b0c8b295820e32d848c3f9af2471ad9" exitCode=0
Jul 23 18:04:30.553663 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.553627    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8" event={"ID":"e9d93db6-c396-43fa-b155-5ace5f39e57e","Type":"ContainerDied","Data":"f278dfcebfcfcbfb64d78fbb666669054b0c8b295820e32d848c3f9af2471ad9"}
Jul 23 18:04:30.553774 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.553665    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8" event={"ID":"e9d93db6-c396-43fa-b155-5ace5f39e57e","Type":"ContainerStarted","Data":"f89f8b85836a4be4ffc404c28a782dc615cddee4fee15fe94de307b606cd98bf"}
Jul 23 18:04:30.588117 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.588096    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.588268 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.588124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.588268 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.588142    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpxg6\" (UniqueName: \"kubernetes.io/projected/9617f51f-c205-44f5-917a-18b9c9892274-kube-api-access-zpxg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.688899 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.688864    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.689027 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.689005    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.689095 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.689038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpxg6\" (UniqueName: \"kubernetes.io/projected/9617f51f-c205-44f5-917a-18b9c9892274-kube-api-access-zpxg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.689237 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.689216    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.689320 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.689304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.701262 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.701243    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpxg6\" (UniqueName: \"kubernetes.io/projected/9617f51f-c205-44f5-917a-18b9c9892274-kube-api-access-zpxg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.795842 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.795790    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:30.933241 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:30.933213    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"]
Jul 23 18:04:30.935361 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:30.935335    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9617f51f_c205_44f5_917a_18b9c9892274.slice/crio-df9acedb155fd76dbadd1eb202a53e898f9669a35df7998c6848fb9f17c9f038 WatchSource:0}: Error finding container df9acedb155fd76dbadd1eb202a53e898f9669a35df7998c6848fb9f17c9f038: Status 404 returned error can't find the container with id df9acedb155fd76dbadd1eb202a53e898f9669a35df7998c6848fb9f17c9f038
Jul 23 18:04:31.560398 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:31.560363    2572 generic.go:356] "Generic (PLEG): container finished" podID="9617f51f-c205-44f5-917a-18b9c9892274" containerID="ff4b8a937dd532e8aa963a292164e2d172cfba7a2377c23c0b413a924b45a0d2" exitCode=0
Jul 23 18:04:31.560829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:31.560447    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5" event={"ID":"9617f51f-c205-44f5-917a-18b9c9892274","Type":"ContainerDied","Data":"ff4b8a937dd532e8aa963a292164e2d172cfba7a2377c23c0b413a924b45a0d2"}
Jul 23 18:04:31.560829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:31.560520    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5" event={"ID":"9617f51f-c205-44f5-917a-18b9c9892274","Type":"ContainerStarted","Data":"df9acedb155fd76dbadd1eb202a53e898f9669a35df7998c6848fb9f17c9f038"}
Jul 23 18:04:31.562324 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:31.562297    2572 generic.go:356] "Generic (PLEG): container finished" podID="02eeafca-9104-4da9-949d-32b27607df69" containerID="f465e1ba39ab07118d75ab4710476235d693f1c44580da9a4ac9e37f12e63bb2" exitCode=0
Jul 23 18:04:31.562407 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:31.562374    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s" event={"ID":"02eeafca-9104-4da9-949d-32b27607df69","Type":"ContainerDied","Data":"f465e1ba39ab07118d75ab4710476235d693f1c44580da9a4ac9e37f12e63bb2"}
Jul 23 18:04:31.568489 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:31.568463    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4" event={"ID":"36469446-5487-400d-8b15-1008c0e8e63b","Type":"ContainerStarted","Data":"277fe00771daafa6d7f6915cb5391013e7cbf33c2c2830d8685f474aecefc661"}
Jul 23 18:04:31.571241 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:31.571218    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8" event={"ID":"e9d93db6-c396-43fa-b155-5ace5f39e57e","Type":"ContainerStarted","Data":"9110a27e978b3690ecb66178a7bea2c0af60e69c62aae8e320469f4f5446dce2"}
Jul 23 18:04:32.577866 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:32.577831    2572 generic.go:356] "Generic (PLEG): container finished" podID="36469446-5487-400d-8b15-1008c0e8e63b" containerID="277fe00771daafa6d7f6915cb5391013e7cbf33c2c2830d8685f474aecefc661" exitCode=0
Jul 23 18:04:32.578430 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:32.577889    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4" event={"ID":"36469446-5487-400d-8b15-1008c0e8e63b","Type":"ContainerDied","Data":"277fe00771daafa6d7f6915cb5391013e7cbf33c2c2830d8685f474aecefc661"}
Jul 23 18:04:32.579767 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:32.579724    2572 generic.go:356] "Generic (PLEG): container finished" podID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerID="9110a27e978b3690ecb66178a7bea2c0af60e69c62aae8e320469f4f5446dce2" exitCode=0
Jul 23 18:04:32.579866 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:32.579782    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8" event={"ID":"e9d93db6-c396-43fa-b155-5ace5f39e57e","Type":"ContainerDied","Data":"9110a27e978b3690ecb66178a7bea2c0af60e69c62aae8e320469f4f5446dce2"}
Jul 23 18:04:33.585850 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:33.585817    2572 generic.go:356] "Generic (PLEG): container finished" podID="9617f51f-c205-44f5-917a-18b9c9892274" containerID="b869706f89ae5be1d2478bf019ed3d73fdc6941d316c7c730115a32c70c521cd" exitCode=0
Jul 23 18:04:33.586274 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:33.585864    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5" event={"ID":"9617f51f-c205-44f5-917a-18b9c9892274","Type":"ContainerDied","Data":"b869706f89ae5be1d2478bf019ed3d73fdc6941d316c7c730115a32c70c521cd"}
Jul 23 18:04:33.587889 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:33.587868    2572 generic.go:356] "Generic (PLEG): container finished" podID="02eeafca-9104-4da9-949d-32b27607df69" containerID="beb08577a263e3bded17bf6aab1ca4579cdf4c91e498450601ad51619077be1e" exitCode=0
Jul 23 18:04:33.587998 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:33.587937    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s" event={"ID":"02eeafca-9104-4da9-949d-32b27607df69","Type":"ContainerDied","Data":"beb08577a263e3bded17bf6aab1ca4579cdf4c91e498450601ad51619077be1e"}
Jul 23 18:04:33.590007 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:33.589989    2572 generic.go:356] "Generic (PLEG): container finished" podID="36469446-5487-400d-8b15-1008c0e8e63b" containerID="bc3381236fa3d76c0e811b8a6f8e0f749b64520f9a153f8ce30407918d3b7681" exitCode=0
Jul 23 18:04:33.590094 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:33.590077    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4" event={"ID":"36469446-5487-400d-8b15-1008c0e8e63b","Type":"ContainerDied","Data":"bc3381236fa3d76c0e811b8a6f8e0f749b64520f9a153f8ce30407918d3b7681"}
Jul 23 18:04:33.592268 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:33.592250    2572 generic.go:356] "Generic (PLEG): container finished" podID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerID="bdf9eea096d95273b321db7efdee250df8a79fbd5280751b8f1b00054503521a" exitCode=0
Jul 23 18:04:33.592341 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:33.592295    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8" event={"ID":"e9d93db6-c396-43fa-b155-5ace5f39e57e","Type":"ContainerDied","Data":"bdf9eea096d95273b321db7efdee250df8a79fbd5280751b8f1b00054503521a"}
Jul 23 18:04:34.599244 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.599206    2572 generic.go:356] "Generic (PLEG): container finished" podID="9617f51f-c205-44f5-917a-18b9c9892274" containerID="a313174559d37c8b113cdf04a061a63776ced01958cdd86894ac1c2f4df10fde" exitCode=0
Jul 23 18:04:34.599676 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.599310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5" event={"ID":"9617f51f-c205-44f5-917a-18b9c9892274","Type":"ContainerDied","Data":"a313174559d37c8b113cdf04a061a63776ced01958cdd86894ac1c2f4df10fde"}
Jul 23 18:04:34.601299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.601276    2572 generic.go:356] "Generic (PLEG): container finished" podID="02eeafca-9104-4da9-949d-32b27607df69" containerID="eba1bc4c3c17d96b208c160d019b40580e7fcbb7ee55771ce817f6749f8ff457" exitCode=0
Jul 23 18:04:34.601390 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.601309    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s" event={"ID":"02eeafca-9104-4da9-949d-32b27607df69","Type":"ContainerDied","Data":"eba1bc4c3c17d96b208c160d019b40580e7fcbb7ee55771ce817f6749f8ff457"}
Jul 23 18:04:34.754937 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.754914    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:34.757708 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.757691    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:34.825382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.825351    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-util\") pod \"e9d93db6-c396-43fa-b155-5ace5f39e57e\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") "
Jul 23 18:04:34.825545 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.825423    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlczh\" (UniqueName: \"kubernetes.io/projected/e9d93db6-c396-43fa-b155-5ace5f39e57e-kube-api-access-qlczh\") pod \"e9d93db6-c396-43fa-b155-5ace5f39e57e\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") "
Jul 23 18:04:34.825545 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.825472    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-bundle\") pod \"e9d93db6-c396-43fa-b155-5ace5f39e57e\" (UID: \"e9d93db6-c396-43fa-b155-5ace5f39e57e\") "
Jul 23 18:04:34.826009 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.825982    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-bundle" (OuterVolumeSpecName: "bundle") pod "e9d93db6-c396-43fa-b155-5ace5f39e57e" (UID: "e9d93db6-c396-43fa-b155-5ace5f39e57e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:34.827570 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.827544    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d93db6-c396-43fa-b155-5ace5f39e57e-kube-api-access-qlczh" (OuterVolumeSpecName: "kube-api-access-qlczh") pod "e9d93db6-c396-43fa-b155-5ace5f39e57e" (UID: "e9d93db6-c396-43fa-b155-5ace5f39e57e"). InnerVolumeSpecName "kube-api-access-qlczh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:34.830447 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.830411    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-util" (OuterVolumeSpecName: "util") pod "e9d93db6-c396-43fa-b155-5ace5f39e57e" (UID: "e9d93db6-c396-43fa-b155-5ace5f39e57e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:34.926812 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.926705    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4tsm\" (UniqueName: \"kubernetes.io/projected/36469446-5487-400d-8b15-1008c0e8e63b-kube-api-access-z4tsm\") pod \"36469446-5487-400d-8b15-1008c0e8e63b\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") "
Jul 23 18:04:34.926812 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.926793    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-bundle\") pod \"36469446-5487-400d-8b15-1008c0e8e63b\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") "
Jul 23 18:04:34.927027 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.926854    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-util\") pod \"36469446-5487-400d-8b15-1008c0e8e63b\" (UID: \"36469446-5487-400d-8b15-1008c0e8e63b\") "
Jul 23 18:04:34.927097 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.927080    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-util\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:34.927194 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.927104    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlczh\" (UniqueName: \"kubernetes.io/projected/e9d93db6-c396-43fa-b155-5ace5f39e57e-kube-api-access-qlczh\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:34.927194 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.927120    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d93db6-c396-43fa-b155-5ace5f39e57e-bundle\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:34.927377 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.927350    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-bundle" (OuterVolumeSpecName: "bundle") pod "36469446-5487-400d-8b15-1008c0e8e63b" (UID: "36469446-5487-400d-8b15-1008c0e8e63b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:34.928863 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.928841    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36469446-5487-400d-8b15-1008c0e8e63b-kube-api-access-z4tsm" (OuterVolumeSpecName: "kube-api-access-z4tsm") pod "36469446-5487-400d-8b15-1008c0e8e63b" (UID: "36469446-5487-400d-8b15-1008c0e8e63b"). InnerVolumeSpecName "kube-api-access-z4tsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:34.935185 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:34.935142    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-util" (OuterVolumeSpecName: "util") pod "36469446-5487-400d-8b15-1008c0e8e63b" (UID: "36469446-5487-400d-8b15-1008c0e8e63b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:35.027933 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.027901    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-util\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.027933 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.027928    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4tsm\" (UniqueName: \"kubernetes.io/projected/36469446-5487-400d-8b15-1008c0e8e63b-kube-api-access-z4tsm\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.027933 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.027938    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36469446-5487-400d-8b15-1008c0e8e63b-bundle\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.607252 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.607214    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4"
Jul 23 18:04:35.607665 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.607214    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4" event={"ID":"36469446-5487-400d-8b15-1008c0e8e63b","Type":"ContainerDied","Data":"fe6969377f56c3ee779bf7d8e6a2b5c1bda59f0a95f09aa08c6b2c5467b625c4"}
Jul 23 18:04:35.607665 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.607332    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe6969377f56c3ee779bf7d8e6a2b5c1bda59f0a95f09aa08c6b2c5467b625c4"
Jul 23 18:04:35.609218 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.609200    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8"
Jul 23 18:04:35.609333 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.609230    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8" event={"ID":"e9d93db6-c396-43fa-b155-5ace5f39e57e","Type":"ContainerDied","Data":"f89f8b85836a4be4ffc404c28a782dc615cddee4fee15fe94de307b606cd98bf"}
Jul 23 18:04:35.609333 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.609274    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f89f8b85836a4be4ffc404c28a782dc615cddee4fee15fe94de307b606cd98bf"
Jul 23 18:04:35.740450 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.740425    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:35.767329 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.767301    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:35.834657 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.834631    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpxg6\" (UniqueName: \"kubernetes.io/projected/9617f51f-c205-44f5-917a-18b9c9892274-kube-api-access-zpxg6\") pod \"9617f51f-c205-44f5-917a-18b9c9892274\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") "
Jul 23 18:04:35.834831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.834726    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-util\") pod \"9617f51f-c205-44f5-917a-18b9c9892274\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") "
Jul 23 18:04:35.834899 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.834827    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-bundle\") pod \"9617f51f-c205-44f5-917a-18b9c9892274\" (UID: \"9617f51f-c205-44f5-917a-18b9c9892274\") "
Jul 23 18:04:35.835272 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.835238    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-bundle" (OuterVolumeSpecName: "bundle") pod "9617f51f-c205-44f5-917a-18b9c9892274" (UID: "9617f51f-c205-44f5-917a-18b9c9892274"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:35.836721 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.836697    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9617f51f-c205-44f5-917a-18b9c9892274-kube-api-access-zpxg6" (OuterVolumeSpecName: "kube-api-access-zpxg6") pod "9617f51f-c205-44f5-917a-18b9c9892274" (UID: "9617f51f-c205-44f5-917a-18b9c9892274"). InnerVolumeSpecName "kube-api-access-zpxg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:35.839658 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.839621    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-util" (OuterVolumeSpecName: "util") pod "9617f51f-c205-44f5-917a-18b9c9892274" (UID: "9617f51f-c205-44f5-917a-18b9c9892274"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:35.935809 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.935691    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-util\") pod \"02eeafca-9104-4da9-949d-32b27607df69\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") "
Jul 23 18:04:35.935809 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.935801    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-bundle\") pod \"02eeafca-9104-4da9-949d-32b27607df69\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") "
Jul 23 18:04:35.936030 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.935838    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp2ld\" (UniqueName: \"kubernetes.io/projected/02eeafca-9104-4da9-949d-32b27607df69-kube-api-access-wp2ld\") pod \"02eeafca-9104-4da9-949d-32b27607df69\" (UID: \"02eeafca-9104-4da9-949d-32b27607df69\") "
Jul 23 18:04:35.936094 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.936072    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-bundle\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.936146 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.936101    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpxg6\" (UniqueName: \"kubernetes.io/projected/9617f51f-c205-44f5-917a-18b9c9892274-kube-api-access-zpxg6\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.936146 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.936115    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9617f51f-c205-44f5-917a-18b9c9892274-util\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.936241 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.936215    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-bundle" (OuterVolumeSpecName: "bundle") pod "02eeafca-9104-4da9-949d-32b27607df69" (UID: "02eeafca-9104-4da9-949d-32b27607df69"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:35.937906 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.937878    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02eeafca-9104-4da9-949d-32b27607df69-kube-api-access-wp2ld" (OuterVolumeSpecName: "kube-api-access-wp2ld") pod "02eeafca-9104-4da9-949d-32b27607df69" (UID: "02eeafca-9104-4da9-949d-32b27607df69"). InnerVolumeSpecName "kube-api-access-wp2ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:35.940871 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:35.940846    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-util" (OuterVolumeSpecName: "util") pod "02eeafca-9104-4da9-949d-32b27607df69" (UID: "02eeafca-9104-4da9-949d-32b27607df69"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:04:36.037080 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.037049    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp2ld\" (UniqueName: \"kubernetes.io/projected/02eeafca-9104-4da9-949d-32b27607df69-kube-api-access-wp2ld\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:36.037080 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.037072    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-util\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:36.037080 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.037082    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02eeafca-9104-4da9-949d-32b27607df69-bundle\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:04:36.615285 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.615256    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s"
Jul 23 18:04:36.615285 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.615270    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s" event={"ID":"02eeafca-9104-4da9-949d-32b27607df69","Type":"ContainerDied","Data":"7f82538db2d6a4b9f5b2562bb2e1ad9ecd874d37e00d24af782f011c417023f6"}
Jul 23 18:04:36.615762 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.615325    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f82538db2d6a4b9f5b2562bb2e1ad9ecd874d37e00d24af782f011c417023f6"
Jul 23 18:04:36.617199 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.617177    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5" event={"ID":"9617f51f-c205-44f5-917a-18b9c9892274","Type":"ContainerDied","Data":"df9acedb155fd76dbadd1eb202a53e898f9669a35df7998c6848fb9f17c9f038"}
Jul 23 18:04:36.617199 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.617195    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5"
Jul 23 18:04:36.617339 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:36.617211    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df9acedb155fd76dbadd1eb202a53e898f9669a35df7998c6848fb9f17c9f038"
Jul 23 18:04:45.320856 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.320825    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"]
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321118    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02eeafca-9104-4da9-949d-32b27607df69" containerName="util"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321128    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02eeafca-9104-4da9-949d-32b27607df69" containerName="util"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321138    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36469446-5487-400d-8b15-1008c0e8e63b" containerName="pull"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321143    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="36469446-5487-400d-8b15-1008c0e8e63b" containerName="pull"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321156    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerName="pull"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321161    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerName="pull"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321167    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36469446-5487-400d-8b15-1008c0e8e63b" containerName="extract"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321172    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="36469446-5487-400d-8b15-1008c0e8e63b" containerName="extract"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321179    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9617f51f-c205-44f5-917a-18b9c9892274" containerName="pull"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321184    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9617f51f-c205-44f5-917a-18b9c9892274" containerName="pull"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321189    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9617f51f-c205-44f5-917a-18b9c9892274" containerName="extract"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321194    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9617f51f-c205-44f5-917a-18b9c9892274" containerName="extract"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321203    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerName="util"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321209    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerName="util"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321215    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36469446-5487-400d-8b15-1008c0e8e63b" containerName="util"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321220    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="36469446-5487-400d-8b15-1008c0e8e63b" containerName="util"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321225    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerName="extract"
Jul 23 18:04:45.321226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321231    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerName="extract"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321240    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9617f51f-c205-44f5-917a-18b9c9892274" containerName="util"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321245    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9617f51f-c205-44f5-917a-18b9c9892274" containerName="util"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321250    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02eeafca-9104-4da9-949d-32b27607df69" containerName="pull"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321254    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02eeafca-9104-4da9-949d-32b27607df69" containerName="pull"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321261    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02eeafca-9104-4da9-949d-32b27607df69" containerName="extract"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321267    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02eeafca-9104-4da9-949d-32b27607df69" containerName="extract"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321315    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d93db6-c396-43fa-b155-5ace5f39e57e" containerName="extract"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321322    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="02eeafca-9104-4da9-949d-32b27607df69" containerName="extract"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321329    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="36469446-5487-400d-8b15-1008c0e8e63b" containerName="extract"
Jul 23 18:04:45.321722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.321334    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9617f51f-c205-44f5-917a-18b9c9892274" containerName="extract"
Jul 23 18:04:45.325605 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.325586    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:04:45.329275 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.329254    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vjk8s\""
Jul 23 18:04:45.364202 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.364178    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"]
Jul 23 18:04:45.511208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.511176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmdj7\" (UniqueName: \"kubernetes.io/projected/93e15997-7ccf-4952-b00c-3bdf7787362c-kube-api-access-lmdj7\") pod \"limitador-operator-controller-manager-859d7b78bd-j2k4b\" (UID: \"93e15997-7ccf-4952-b00c-3bdf7787362c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:04:45.612114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.612046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmdj7\" (UniqueName: \"kubernetes.io/projected/93e15997-7ccf-4952-b00c-3bdf7787362c-kube-api-access-lmdj7\") pod \"limitador-operator-controller-manager-859d7b78bd-j2k4b\" (UID: \"93e15997-7ccf-4952-b00c-3bdf7787362c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:04:45.626764 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.626730    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmdj7\" (UniqueName: \"kubernetes.io/projected/93e15997-7ccf-4952-b00c-3bdf7787362c-kube-api-access-lmdj7\") pod \"limitador-operator-controller-manager-859d7b78bd-j2k4b\" (UID: \"93e15997-7ccf-4952-b00c-3bdf7787362c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:04:45.635557 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.635534    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:04:45.765769 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:45.765731    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"]
Jul 23 18:04:45.767712 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:45.767684    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e15997_7ccf_4952_b00c_3bdf7787362c.slice/crio-3c7483f3119506fbaa57ca30e857246b9c3239714902227a21db9f8ed2232778 WatchSource:0}: Error finding container 3c7483f3119506fbaa57ca30e857246b9c3239714902227a21db9f8ed2232778: Status 404 returned error can't find the container with id 3c7483f3119506fbaa57ca30e857246b9c3239714902227a21db9f8ed2232778
Jul 23 18:04:46.668256 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:46.668222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b" event={"ID":"93e15997-7ccf-4952-b00c-3bdf7787362c","Type":"ContainerStarted","Data":"3c7483f3119506fbaa57ca30e857246b9c3239714902227a21db9f8ed2232778"}
Jul 23 18:04:48.680379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:48.680346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b" event={"ID":"93e15997-7ccf-4952-b00c-3bdf7787362c","Type":"ContainerStarted","Data":"2ac918473201866dd7a6356e9ab56dd30404c766b1389dc663144275ee485260"}
Jul 23 18:04:48.680784 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:48.680416    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:04:48.703314 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:48.703270    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b" podStartSLOduration=1.321964552 podStartE2EDuration="3.703255272s" totalImagesPullingTime="2.38129072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:48.70225952 +0000 UTC m=+430.534950701" watchObservedRunningTime="2026-07-23 18:04:48.703255272 +0000 UTC m=+430.535946430"
Jul 23 18:04:50.477865 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.477822    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"]
Jul 23 18:04:50.485490 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.485461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:50.488760 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.488728    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kmcwq\""
Jul 23 18:04:50.499923 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.499900    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"]
Jul 23 18:04:50.552389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.552350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j97nl\" (UniqueName: \"kubernetes.io/projected/2c083842-059d-44de-bf43-5f6ef798516a-kube-api-access-j97nl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" (UID: \"2c083842-059d-44de-bf43-5f6ef798516a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:50.552554 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.552470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c083842-059d-44de-bf43-5f6ef798516a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" (UID: \"2c083842-059d-44de-bf43-5f6ef798516a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:50.653033 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.652996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c083842-059d-44de-bf43-5f6ef798516a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" (UID: \"2c083842-059d-44de-bf43-5f6ef798516a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:50.653202 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.653039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j97nl\" (UniqueName: \"kubernetes.io/projected/2c083842-059d-44de-bf43-5f6ef798516a-kube-api-access-j97nl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" (UID: \"2c083842-059d-44de-bf43-5f6ef798516a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:50.653400 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.653382    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c083842-059d-44de-bf43-5f6ef798516a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" (UID: \"2c083842-059d-44de-bf43-5f6ef798516a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:50.672308 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.672282    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j97nl\" (UniqueName: \"kubernetes.io/projected/2c083842-059d-44de-bf43-5f6ef798516a-kube-api-access-j97nl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" (UID: \"2c083842-059d-44de-bf43-5f6ef798516a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:50.795031 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.795002    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:50.937204 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:50.937170    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"]
Jul 23 18:04:50.937307 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:50.937263    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c083842_059d_44de_bf43_5f6ef798516a.slice/crio-72e77f5cb2f7820af14d6b7b7033cbd00df118a177a1cfe25069fd43b9149c75 WatchSource:0}: Error finding container 72e77f5cb2f7820af14d6b7b7033cbd00df118a177a1cfe25069fd43b9149c75: Status 404 returned error can't find the container with id 72e77f5cb2f7820af14d6b7b7033cbd00df118a177a1cfe25069fd43b9149c75
Jul 23 18:04:51.695399 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:51.695367    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx" event={"ID":"2c083842-059d-44de-bf43-5f6ef798516a","Type":"ContainerStarted","Data":"72e77f5cb2f7820af14d6b7b7033cbd00df118a177a1cfe25069fd43b9149c75"}
Jul 23 18:04:53.783865 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:53.783832    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"]
Jul 23 18:04:53.787578 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:53.787556    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"
Jul 23 18:04:53.791823 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:53.791803    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j4ph2\""
Jul 23 18:04:53.792126 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:53.792111    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 18:04:53.813323 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:53.813290    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"]
Jul 23 18:04:53.879004 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:53.878975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5fqj\" (UniqueName: \"kubernetes.io/projected/75db02e5-9787-4302-8a4e-28548007f066-kube-api-access-p5fqj\") pod \"dns-operator-controller-manager-864dd78c4c-hwtdx\" (UID: \"75db02e5-9787-4302-8a4e-28548007f066\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"
Jul 23 18:04:53.979983 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:53.979947    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fqj\" (UniqueName: \"kubernetes.io/projected/75db02e5-9787-4302-8a4e-28548007f066-kube-api-access-p5fqj\") pod \"dns-operator-controller-manager-864dd78c4c-hwtdx\" (UID: \"75db02e5-9787-4302-8a4e-28548007f066\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"
Jul 23 18:04:53.996525 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:53.996501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5fqj\" (UniqueName: \"kubernetes.io/projected/75db02e5-9787-4302-8a4e-28548007f066-kube-api-access-p5fqj\") pod \"dns-operator-controller-manager-864dd78c4c-hwtdx\" (UID: \"75db02e5-9787-4302-8a4e-28548007f066\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"
Jul 23 18:04:54.098153 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:54.098079    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"
Jul 23 18:04:54.297546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:54.297512    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"]
Jul 23 18:04:54.302508 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:54.302473    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75db02e5_9787_4302_8a4e_28548007f066.slice/crio-404405c433bffdacade790c8402aacaeb5f014d68b8da51a33585b85cd039c8d WatchSource:0}: Error finding container 404405c433bffdacade790c8402aacaeb5f014d68b8da51a33585b85cd039c8d: Status 404 returned error can't find the container with id 404405c433bffdacade790c8402aacaeb5f014d68b8da51a33585b85cd039c8d
Jul 23 18:04:54.712694 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:54.712658    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx" event={"ID":"75db02e5-9787-4302-8a4e-28548007f066","Type":"ContainerStarted","Data":"404405c433bffdacade790c8402aacaeb5f014d68b8da51a33585b85cd039c8d"}
Jul 23 18:04:57.731827 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.731787    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx" event={"ID":"2c083842-059d-44de-bf43-5f6ef798516a","Type":"ContainerStarted","Data":"7c5b637965d17ce95fbfe00f706064b655ac3aeaf01eb0318eb0bc1a6d63f79a"}
Jul 23 18:04:57.732280 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.731910    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:04:57.733475 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.733448    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx" event={"ID":"75db02e5-9787-4302-8a4e-28548007f066","Type":"ContainerStarted","Data":"71bc184037a0e2a500c48ba213773202d1d957325223d8a83e32f059992498af"}
Jul 23 18:04:57.733593 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.733499    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"
Jul 23 18:04:57.761827 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.761789    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx" podStartSLOduration=1.526226056 podStartE2EDuration="7.761774956s" totalImagesPullingTime="6.2355489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:57.761046639 +0000 UTC m=+439.593737811" watchObservedRunningTime="2026-07-23 18:04:57.761774956 +0000 UTC m=+439.594466113"
Jul 23 18:04:57.897353 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.897303    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx" podStartSLOduration=1.9759794510000002 podStartE2EDuration="4.897287466s" totalImagesPullingTime="2.921308015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:04:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:57.793368041 +0000 UTC m=+439.626059201" watchObservedRunningTime="2026-07-23 18:04:57.897287466 +0000 UTC m=+439.729978625"
Jul 23 18:04:57.898503 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.898483    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"]
Jul 23 18:04:57.901911 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.901894    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"
Jul 23 18:04:57.907404 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.907381    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-j9cxw\""
Jul 23 18:04:57.923521 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.923501    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"]
Jul 23 18:04:57.926120 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:57.926099    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55fjk\" (UniqueName: \"kubernetes.io/projected/e677afc8-dba4-4c66-9522-8765d61b1878-kube-api-access-55fjk\") pod \"authorino-operator-75cc8d5cb7-pk77g\" (UID: \"e677afc8-dba4-4c66-9522-8765d61b1878\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"
Jul 23 18:04:58.027124 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:58.027092    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55fjk\" (UniqueName: \"kubernetes.io/projected/e677afc8-dba4-4c66-9522-8765d61b1878-kube-api-access-55fjk\") pod \"authorino-operator-75cc8d5cb7-pk77g\" (UID: \"e677afc8-dba4-4c66-9522-8765d61b1878\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"
Jul 23 18:04:58.037980 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:58.037950    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55fjk\" (UniqueName: \"kubernetes.io/projected/e677afc8-dba4-4c66-9522-8765d61b1878-kube-api-access-55fjk\") pod \"authorino-operator-75cc8d5cb7-pk77g\" (UID: \"e677afc8-dba4-4c66-9522-8765d61b1878\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"
Jul 23 18:04:58.211469 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:58.211435    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"
Jul 23 18:04:58.371858 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:58.371833    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"]
Jul 23 18:04:58.374104 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:04:58.374082    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode677afc8_dba4_4c66_9522_8765d61b1878.slice/crio-dce9a7bdf94e6242583a554a0d6ba1bcb0d73437de7bfc2a4326d51848970752 WatchSource:0}: Error finding container dce9a7bdf94e6242583a554a0d6ba1bcb0d73437de7bfc2a4326d51848970752: Status 404 returned error can't find the container with id dce9a7bdf94e6242583a554a0d6ba1bcb0d73437de7bfc2a4326d51848970752
Jul 23 18:04:58.740188 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:58.740095    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g" event={"ID":"e677afc8-dba4-4c66-9522-8765d61b1878","Type":"ContainerStarted","Data":"dce9a7bdf94e6242583a554a0d6ba1bcb0d73437de7bfc2a4326d51848970752"}
Jul 23 18:04:59.687931 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:04:59.687896    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:05:01.760889 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:01.760846    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g" event={"ID":"e677afc8-dba4-4c66-9522-8765d61b1878","Type":"ContainerStarted","Data":"b4e606b12794c2b67b51d003c4f0026db0dafa579eda542b668fcab7eca05337"}
Jul 23 18:05:01.761274 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:01.760974    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"
Jul 23 18:05:01.792243 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:01.792189    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g" podStartSLOduration=2.338718865 podStartE2EDuration="4.792174531s" totalImagesPullingTime="2.453455666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:01.791485483 +0000 UTC m=+443.624176641" watchObservedRunningTime="2026-07-23 18:05:01.792174531 +0000 UTC m=+443.624865689"
Jul 23 18:05:08.742003 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:08.741974    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:05:08.742512 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:08.742140    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hwtdx"
Jul 23 18:05:10.660259 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.660226    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"]
Jul 23 18:05:10.660684 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.660460    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx" podUID="2c083842-059d-44de-bf43-5f6ef798516a" containerName="manager" containerID="cri-o://7c5b637965d17ce95fbfe00f706064b655ac3aeaf01eb0318eb0bc1a6d63f79a" gracePeriod=2
Jul 23 18:05:10.664522 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.664494    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"]
Jul 23 18:05:10.665359 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:10.665316    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="2c083842-059d-44de-bf43-5f6ef798516a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:05:10.675162 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.675138    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"]
Jul 23 18:05:10.675526 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.675478    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b" podUID="93e15997-7ccf-4952-b00c-3bdf7787362c" containerName="manager" containerID="cri-o://2ac918473201866dd7a6356e9ab56dd30404c766b1389dc663144275ee485260" gracePeriod=2
Jul 23 18:05:10.686107 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:10.686064    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j2k4b\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="93e15997-7ccf-4952-b00c-3bdf7787362c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:05:10.688891 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.688853    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"]
Jul 23 18:05:10.691923 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:10.691888    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="2c083842-059d-44de-bf43-5f6ef798516a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:05:10.699724 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.699701    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"]
Jul 23 18:05:10.700058 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.700042    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c083842-059d-44de-bf43-5f6ef798516a" containerName="manager"
Jul 23 18:05:10.700129 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.700062    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c083842-059d-44de-bf43-5f6ef798516a" containerName="manager"
Jul 23 18:05:10.700129 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.700099    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e15997-7ccf-4952-b00c-3bdf7787362c" containerName="manager"
Jul 23 18:05:10.700129 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.700110    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e15997-7ccf-4952-b00c-3bdf7787362c" containerName="manager"
Jul 23 18:05:10.700274 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.700191    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="93e15997-7ccf-4952-b00c-3bdf7787362c" containerName="manager"
Jul 23 18:05:10.700274 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.700207    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c083842-059d-44de-bf43-5f6ef798516a" containerName="manager"
Jul 23 18:05:10.703300 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.703280    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:10.709498 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:10.709468    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="2c083842-059d-44de-bf43-5f6ef798516a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:05:10.743010 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.742979    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"]
Jul 23 18:05:10.776634 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:10.776599    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j2k4b\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="93e15997-7ccf-4952-b00c-3bdf7787362c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:05:10.780895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.780858    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"]
Jul 23 18:05:10.784103 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.784085    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"
Jul 23 18:05:10.806374 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.806346    2572 generic.go:356] "Generic (PLEG): container finished" podID="2c083842-059d-44de-bf43-5f6ef798516a" containerID="7c5b637965d17ce95fbfe00f706064b655ac3aeaf01eb0318eb0bc1a6d63f79a" exitCode=0
Jul 23 18:05:10.808382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.808343    2572 generic.go:356] "Generic (PLEG): container finished" podID="93e15997-7ccf-4952-b00c-3bdf7787362c" containerID="2ac918473201866dd7a6356e9ab56dd30404c766b1389dc663144275ee485260" exitCode=0
Jul 23 18:05:10.816673 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.816647    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"]
Jul 23 18:05:10.836959 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:10.836919    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-j2k4b\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="93e15997-7ccf-4952-b00c-3bdf7787362c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:05:10.840113 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:10.840076    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j7zhx\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="2c083842-059d-44de-bf43-5f6ef798516a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:05:10.842516 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.842490    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cz57\" (UniqueName: \"kubernetes.io/projected/d9db2709-70cd-429f-8184-fed1e123c93c-kube-api-access-4cz57\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzbjz\" (UID: \"d9db2709-70cd-429f-8184-fed1e123c93c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:10.842619 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.842559    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf89h\" (UniqueName: \"kubernetes.io/projected/c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb-kube-api-access-kf89h\") pod \"limitador-operator-controller-manager-859d7b78bd-svzbv\" (UID: \"c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"
Jul 23 18:05:10.842696 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.842675    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9db2709-70cd-429f-8184-fed1e123c93c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzbjz\" (UID: \"d9db2709-70cd-429f-8184-fed1e123c93c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:10.935193 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.935173    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:05:10.937153 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.937134    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:05:10.943659 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.943642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cz57\" (UniqueName: \"kubernetes.io/projected/d9db2709-70cd-429f-8184-fed1e123c93c-kube-api-access-4cz57\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzbjz\" (UID: \"d9db2709-70cd-429f-8184-fed1e123c93c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:10.943745 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.943692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf89h\" (UniqueName: \"kubernetes.io/projected/c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb-kube-api-access-kf89h\") pod \"limitador-operator-controller-manager-859d7b78bd-svzbv\" (UID: \"c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"
Jul 23 18:05:10.943811 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.943775    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9db2709-70cd-429f-8184-fed1e123c93c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzbjz\" (UID: \"d9db2709-70cd-429f-8184-fed1e123c93c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:10.944081 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.944065    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9db2709-70cd-429f-8184-fed1e123c93c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzbjz\" (UID: \"d9db2709-70cd-429f-8184-fed1e123c93c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:10.959324 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.959295    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cz57\" (UniqueName: \"kubernetes.io/projected/d9db2709-70cd-429f-8184-fed1e123c93c-kube-api-access-4cz57\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzbjz\" (UID: \"d9db2709-70cd-429f-8184-fed1e123c93c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:10.959438 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:10.959415    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf89h\" (UniqueName: \"kubernetes.io/projected/c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb-kube-api-access-kf89h\") pod \"limitador-operator-controller-manager-859d7b78bd-svzbv\" (UID: \"c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"
Jul 23 18:05:11.044993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.044961    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmdj7\" (UniqueName: \"kubernetes.io/projected/93e15997-7ccf-4952-b00c-3bdf7787362c-kube-api-access-lmdj7\") pod \"93e15997-7ccf-4952-b00c-3bdf7787362c\" (UID: \"93e15997-7ccf-4952-b00c-3bdf7787362c\") "
Jul 23 18:05:11.045167 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.045004    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j97nl\" (UniqueName: \"kubernetes.io/projected/2c083842-059d-44de-bf43-5f6ef798516a-kube-api-access-j97nl\") pod \"2c083842-059d-44de-bf43-5f6ef798516a\" (UID: \"2c083842-059d-44de-bf43-5f6ef798516a\") "
Jul 23 18:05:11.045167 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.045062    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c083842-059d-44de-bf43-5f6ef798516a-extensions-socket-volume\") pod \"2c083842-059d-44de-bf43-5f6ef798516a\" (UID: \"2c083842-059d-44de-bf43-5f6ef798516a\") "
Jul 23 18:05:11.045564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.045538    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c083842-059d-44de-bf43-5f6ef798516a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c083842-059d-44de-bf43-5f6ef798516a" (UID: "2c083842-059d-44de-bf43-5f6ef798516a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:05:11.047126 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.047093    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e15997-7ccf-4952-b00c-3bdf7787362c-kube-api-access-lmdj7" (OuterVolumeSpecName: "kube-api-access-lmdj7") pod "93e15997-7ccf-4952-b00c-3bdf7787362c" (UID: "93e15997-7ccf-4952-b00c-3bdf7787362c"). InnerVolumeSpecName "kube-api-access-lmdj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:05:11.047126 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.047099    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c083842-059d-44de-bf43-5f6ef798516a-kube-api-access-j97nl" (OuterVolumeSpecName: "kube-api-access-j97nl") pod "2c083842-059d-44de-bf43-5f6ef798516a" (UID: "2c083842-059d-44de-bf43-5f6ef798516a"). InnerVolumeSpecName "kube-api-access-j97nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:05:11.098437 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.098402    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:11.107633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.107604    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"
Jul 23 18:05:11.145919 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.145867    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmdj7\" (UniqueName: \"kubernetes.io/projected/93e15997-7ccf-4952-b00c-3bdf7787362c-kube-api-access-lmdj7\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:05:11.145919 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.145919    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j97nl\" (UniqueName: \"kubernetes.io/projected/2c083842-059d-44de-bf43-5f6ef798516a-kube-api-access-j97nl\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:05:11.145919 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.145935    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c083842-059d-44de-bf43-5f6ef798516a-extensions-socket-volume\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:05:11.281722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.281697    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"]
Jul 23 18:05:11.283027 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:05:11.282998    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9db2709_70cd_429f_8184_fed1e123c93c.slice/crio-6371f1517c465ba9f8473c175af970fb22e14531079441fe623baa1da90f2525 WatchSource:0}: Error finding container 6371f1517c465ba9f8473c175af970fb22e14531079441fe623baa1da90f2525: Status 404 returned error can't find the container with id 6371f1517c465ba9f8473c175af970fb22e14531079441fe623baa1da90f2525
Jul 23 18:05:11.312951 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.312929    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"]
Jul 23 18:05:11.316813 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:05:11.316781    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10deea0_2b8a_49ed_b8ab_06ae5f0be6fb.slice/crio-36c16104f65b631575ed457378b9b519b53f0e449e5c799fb6deb357d26d6016 WatchSource:0}: Error finding container 36c16104f65b631575ed457378b9b519b53f0e449e5c799fb6deb357d26d6016: Status 404 returned error can't find the container with id 36c16104f65b631575ed457378b9b519b53f0e449e5c799fb6deb357d26d6016
Jul 23 18:05:11.814508 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.814479    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j7zhx"
Jul 23 18:05:11.814508 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.814510    2572 scope.go:117] "RemoveContainer" containerID="7c5b637965d17ce95fbfe00f706064b655ac3aeaf01eb0318eb0bc1a6d63f79a"
Jul 23 18:05:11.816059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.816036    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j2k4b"
Jul 23 18:05:11.817805 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.817778    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv" event={"ID":"c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb","Type":"ContainerStarted","Data":"4f7332e3ce71a3c43953da0fc5a18e18ba9ce03204233d357f854b22626f9411"}
Jul 23 18:05:11.817926 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.817825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv" event={"ID":"c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb","Type":"ContainerStarted","Data":"36c16104f65b631575ed457378b9b519b53f0e449e5c799fb6deb357d26d6016"}
Jul 23 18:05:11.817994 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.817951    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"
Jul 23 18:05:11.819699 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.819674    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz" event={"ID":"d9db2709-70cd-429f-8184-fed1e123c93c","Type":"ContainerStarted","Data":"eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2"}
Jul 23 18:05:11.819802 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.819719    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz" event={"ID":"d9db2709-70cd-429f-8184-fed1e123c93c","Type":"ContainerStarted","Data":"6371f1517c465ba9f8473c175af970fb22e14531079441fe623baa1da90f2525"}
Jul 23 18:05:11.819802 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.819743    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:11.825226 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.825200    2572 scope.go:117] "RemoveContainer" containerID="2ac918473201866dd7a6356e9ab56dd30404c766b1389dc663144275ee485260"
Jul 23 18:05:11.853615 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.853570    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv" podStartSLOduration=1.853558063 podStartE2EDuration="1.853558063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:11.851289557 +0000 UTC m=+453.683980732" watchObservedRunningTime="2026-07-23 18:05:11.853558063 +0000 UTC m=+453.686249221"
Jul 23 18:05:11.881145 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:11.881105    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz" podStartSLOduration=1.8810911620000001 podStartE2EDuration="1.881091162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:11.879319184 +0000 UTC m=+453.712010342" watchObservedRunningTime="2026-07-23 18:05:11.881091162 +0000 UTC m=+453.713782320"
Jul 23 18:05:12.316633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.316598    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"]
Jul 23 18:05:12.321487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.321468    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:12.354537 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.354514    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"]
Jul 23 18:05:12.456513 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.456484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ea0b29-1f06-401f-afb2-316017a6bade-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t9wt7\" (UID: \"86ea0b29-1f06-401f-afb2-316017a6bade\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:12.456676 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.456523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sppms\" (UniqueName: \"kubernetes.io/projected/86ea0b29-1f06-401f-afb2-316017a6bade-kube-api-access-sppms\") pod \"kuadrant-operator-controller-manager-86878c769f-t9wt7\" (UID: \"86ea0b29-1f06-401f-afb2-316017a6bade\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:12.557336 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.557301    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ea0b29-1f06-401f-afb2-316017a6bade-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t9wt7\" (UID: \"86ea0b29-1f06-401f-afb2-316017a6bade\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:12.557473 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.557341    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sppms\" (UniqueName: \"kubernetes.io/projected/86ea0b29-1f06-401f-afb2-316017a6bade-kube-api-access-sppms\") pod \"kuadrant-operator-controller-manager-86878c769f-t9wt7\" (UID: \"86ea0b29-1f06-401f-afb2-316017a6bade\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:12.557663 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.557643    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ea0b29-1f06-401f-afb2-316017a6bade-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t9wt7\" (UID: \"86ea0b29-1f06-401f-afb2-316017a6bade\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:12.570160 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.570101    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sppms\" (UniqueName: \"kubernetes.io/projected/86ea0b29-1f06-401f-afb2-316017a6bade-kube-api-access-sppms\") pod \"kuadrant-operator-controller-manager-86878c769f-t9wt7\" (UID: \"86ea0b29-1f06-401f-afb2-316017a6bade\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:12.631070 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.631043    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:12.767960 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.767931    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pk77g"
Jul 23 18:05:12.789732 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:05:12.789707    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ea0b29_1f06_401f_afb2_316017a6bade.slice/crio-388b901f01d5df88eac63b99fc1caeca18be9d08a6edb94f5ee8250591e4e82d WatchSource:0}: Error finding container 388b901f01d5df88eac63b99fc1caeca18be9d08a6edb94f5ee8250591e4e82d: Status 404 returned error can't find the container with id 388b901f01d5df88eac63b99fc1caeca18be9d08a6edb94f5ee8250591e4e82d
Jul 23 18:05:12.793795 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.793743    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c083842-059d-44de-bf43-5f6ef798516a" path="/var/lib/kubelet/pods/2c083842-059d-44de-bf43-5f6ef798516a/volumes"
Jul 23 18:05:12.794082 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.794069    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e15997-7ccf-4952-b00c-3bdf7787362c" path="/var/lib/kubelet/pods/93e15997-7ccf-4952-b00c-3bdf7787362c/volumes"
Jul 23 18:05:12.794325 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.794313    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"]
Jul 23 18:05:12.827174 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:12.827093    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7" event={"ID":"86ea0b29-1f06-401f-afb2-316017a6bade","Type":"ContainerStarted","Data":"388b901f01d5df88eac63b99fc1caeca18be9d08a6edb94f5ee8250591e4e82d"}
Jul 23 18:05:13.835135 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:13.835105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7" event={"ID":"86ea0b29-1f06-401f-afb2-316017a6bade","Type":"ContainerStarted","Data":"d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9"}
Jul 23 18:05:13.835498 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:13.835166    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:13.893345 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:13.893299    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7" podStartSLOduration=1.893284661 podStartE2EDuration="1.893284661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:13.892551304 +0000 UTC m=+455.725242488" watchObservedRunningTime="2026-07-23 18:05:13.893284661 +0000 UTC m=+455.725975818"
Jul 23 18:05:22.830329 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:22.830292    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:22.830686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:22.830382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-svzbv"
Jul 23 18:05:24.841506 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:24.841476    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:05:24.908053 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:24.908018    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"]
Jul 23 18:05:24.908291 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:24.908244    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz" podUID="d9db2709-70cd-429f-8184-fed1e123c93c" containerName="manager" containerID="cri-o://eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2" gracePeriod=10
Jul 23 18:05:25.158355 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.158332    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:25.266618 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.266588    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9db2709-70cd-429f-8184-fed1e123c93c-extensions-socket-volume\") pod \"d9db2709-70cd-429f-8184-fed1e123c93c\" (UID: \"d9db2709-70cd-429f-8184-fed1e123c93c\") "
Jul 23 18:05:25.266801 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.266724    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cz57\" (UniqueName: \"kubernetes.io/projected/d9db2709-70cd-429f-8184-fed1e123c93c-kube-api-access-4cz57\") pod \"d9db2709-70cd-429f-8184-fed1e123c93c\" (UID: \"d9db2709-70cd-429f-8184-fed1e123c93c\") "
Jul 23 18:05:25.266980 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.266957    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9db2709-70cd-429f-8184-fed1e123c93c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9db2709-70cd-429f-8184-fed1e123c93c" (UID: "d9db2709-70cd-429f-8184-fed1e123c93c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:05:25.268677 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.268657    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9db2709-70cd-429f-8184-fed1e123c93c-kube-api-access-4cz57" (OuterVolumeSpecName: "kube-api-access-4cz57") pod "d9db2709-70cd-429f-8184-fed1e123c93c" (UID: "d9db2709-70cd-429f-8184-fed1e123c93c"). InnerVolumeSpecName "kube-api-access-4cz57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:05:25.368212 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.368177    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cz57\" (UniqueName: \"kubernetes.io/projected/d9db2709-70cd-429f-8184-fed1e123c93c-kube-api-access-4cz57\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:05:25.368212 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.368207    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9db2709-70cd-429f-8184-fed1e123c93c-extensions-socket-volume\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:05:25.894255 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.894214    2572 generic.go:356] "Generic (PLEG): container finished" podID="d9db2709-70cd-429f-8184-fed1e123c93c" containerID="eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2" exitCode=0
Jul 23 18:05:25.894654 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.894261    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"
Jul 23 18:05:25.894654 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.894302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz" event={"ID":"d9db2709-70cd-429f-8184-fed1e123c93c","Type":"ContainerDied","Data":"eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2"}
Jul 23 18:05:25.894654 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.894350    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz" event={"ID":"d9db2709-70cd-429f-8184-fed1e123c93c","Type":"ContainerDied","Data":"6371f1517c465ba9f8473c175af970fb22e14531079441fe623baa1da90f2525"}
Jul 23 18:05:25.894654 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.894374    2572 scope.go:117] "RemoveContainer" containerID="eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2"
Jul 23 18:05:25.903482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.903466    2572 scope.go:117] "RemoveContainer" containerID="eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2"
Jul 23 18:05:25.903776 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:25.903741    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2\": container with ID starting with eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2 not found: ID does not exist" containerID="eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2"
Jul 23 18:05:25.903837 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.903786    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2"} err="failed to get container status \"eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2\": rpc error: code = NotFound desc = could not find container \"eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2\": container with ID starting with eb0010ec245d0d8f91338e8c7406b256a102eb01b474e60ae847ffd00e336de2 not found: ID does not exist"
Jul 23 18:05:25.924242 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.924215    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"]
Jul 23 18:05:25.926370 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:25.926349    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzbjz"]
Jul 23 18:05:26.792537 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:26.792505    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9db2709-70cd-429f-8184-fed1e123c93c" path="/var/lib/kubelet/pods/d9db2709-70cd-429f-8184-fed1e123c93c/volumes"
Jul 23 18:05:41.307895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.307864    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"]
Jul 23 18:05:41.308352 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.308186    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9db2709-70cd-429f-8184-fed1e123c93c" containerName="manager"
Jul 23 18:05:41.308352 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.308197    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9db2709-70cd-429f-8184-fed1e123c93c" containerName="manager"
Jul 23 18:05:41.308352 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.308251    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9db2709-70cd-429f-8184-fed1e123c93c" containerName="manager"
Jul 23 18:05:41.311985 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.311965    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.314652 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.314632    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2zrcp\""
Jul 23 18:05:41.326212 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.326185    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"]
Jul 23 18:05:41.495094 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.495256 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495108    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.495256 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495129    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3116235e-a0d6-433d-9fd7-946f894ae721-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.495256 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495149    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3116235e-a0d6-433d-9fd7-946f894ae721-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.495256 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495211    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.495256 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495243    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3116235e-a0d6-433d-9fd7-946f894ae721-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.495419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495264    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.495419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88t9\" (UniqueName: \"kubernetes.io/projected/3116235e-a0d6-433d-9fd7-946f894ae721-kube-api-access-z88t9\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.495419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.495367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596074 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596074 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3116235e-a0d6-433d-9fd7-946f894ae721-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596074 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3116235e-a0d6-433d-9fd7-946f894ae721-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596074 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596074    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596090    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3116235e-a0d6-433d-9fd7-946f894ae721-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88t9\" (UniqueName: \"kubernetes.io/projected/3116235e-a0d6-433d-9fd7-946f894ae721-kube-api-access-z88t9\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596621 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596463    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596667 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596635    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596717 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596672    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.596717 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.596685    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.597131 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.597109    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3116235e-a0d6-433d-9fd7-946f894ae721-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.598299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.598279    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3116235e-a0d6-433d-9fd7-946f894ae721-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.598644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.598619    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3116235e-a0d6-433d-9fd7-946f894ae721-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.610551 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.610523    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3116235e-a0d6-433d-9fd7-946f894ae721-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.612424 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.612399    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88t9\" (UniqueName: \"kubernetes.io/projected/3116235e-a0d6-433d-9fd7-946f894ae721-kube-api-access-z88t9\") pod \"maas-default-gateway-openshift-default-56654dcf7-zv9kz\" (UID: \"3116235e-a0d6-433d-9fd7-946f894ae721\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.621833 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.621814    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:41.763167 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.763142    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"]
Jul 23 18:05:41.765021 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:05:41.764996    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3116235e_a0d6_433d_9fd7_946f894ae721.slice/crio-28380757736de071d5a80441117a03ed170051ef4b03756c39ffdb2eaf0fa31c WatchSource:0}: Error finding container 28380757736de071d5a80441117a03ed170051ef4b03756c39ffdb2eaf0fa31c: Status 404 returned error can't find the container with id 28380757736de071d5a80441117a03ed170051ef4b03756c39ffdb2eaf0fa31c
Jul 23 18:05:41.767198 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.767166    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:05:41.767273 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.767235    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:05:41.767310 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.767282    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:05:41.974684 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.974599    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" event={"ID":"3116235e-a0d6-433d-9fd7-946f894ae721","Type":"ContainerStarted","Data":"9fc3698e29b09665f703bcd7e0831291fb5c5f7761ded582657162c8bc453be5"}
Jul 23 18:05:41.974684 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:41.974652    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" event={"ID":"3116235e-a0d6-433d-9fd7-946f894ae721","Type":"ContainerStarted","Data":"28380757736de071d5a80441117a03ed170051ef4b03756c39ffdb2eaf0fa31c"}
Jul 23 18:05:42.002891 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:42.002840    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" podStartSLOduration=1.002824113 podStartE2EDuration="1.002824113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:42.002367645 +0000 UTC m=+483.835058803" watchObservedRunningTime="2026-07-23 18:05:42.002824113 +0000 UTC m=+483.835515271"
Jul 23 18:05:42.622458 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:42.622425    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:42.626745 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:42.626723    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:42.979660 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:42.979570    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:42.980628 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:42.980611    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:05:44.063340 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.063308    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8wkvg"]
Jul 23 18:05:44.065803 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.065781    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8wkvg"
Jul 23 18:05:44.068850 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.068828    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lvr5d\""
Jul 23 18:05:44.085432 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.085414    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wkvg"]
Jul 23 18:05:44.219493 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.219460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67phq\" (UniqueName: \"kubernetes.io/projected/08a68117-caee-46cb-9483-a13607acf338-kube-api-access-67phq\") pod \"authorino-58cd955675-8wkvg\" (UID: \"08a68117-caee-46cb-9483-a13607acf338\") " pod="kuadrant-system/authorino-58cd955675-8wkvg"
Jul 23 18:05:44.320853 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.320768    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67phq\" (UniqueName: \"kubernetes.io/projected/08a68117-caee-46cb-9483-a13607acf338-kube-api-access-67phq\") pod \"authorino-58cd955675-8wkvg\" (UID: \"08a68117-caee-46cb-9483-a13607acf338\") " pod="kuadrant-system/authorino-58cd955675-8wkvg"
Jul 23 18:05:44.334902 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.334881    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67phq\" (UniqueName: \"kubernetes.io/projected/08a68117-caee-46cb-9483-a13607acf338-kube-api-access-67phq\") pod \"authorino-58cd955675-8wkvg\" (UID: \"08a68117-caee-46cb-9483-a13607acf338\") " pod="kuadrant-system/authorino-58cd955675-8wkvg"
Jul 23 18:05:44.375090 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.375069    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8wkvg"
Jul 23 18:05:44.510082 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.510049    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wkvg"]
Jul 23 18:05:44.510576 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:05:44.510551    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08a68117_caee_46cb_9483_a13607acf338.slice/crio-4ade6ba4d29cd3ff76036767f031f6c4ce795f74a963c3d4e94354dd5691f02e WatchSource:0}: Error finding container 4ade6ba4d29cd3ff76036767f031f6c4ce795f74a963c3d4e94354dd5691f02e: Status 404 returned error can't find the container with id 4ade6ba4d29cd3ff76036767f031f6c4ce795f74a963c3d4e94354dd5691f02e
Jul 23 18:05:44.991023 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:44.990989    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8wkvg" event={"ID":"08a68117-caee-46cb-9483-a13607acf338","Type":"ContainerStarted","Data":"4ade6ba4d29cd3ff76036767f031f6c4ce795f74a963c3d4e94354dd5691f02e"}
Jul 23 18:05:49.015907 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:49.015873    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8wkvg" event={"ID":"08a68117-caee-46cb-9483-a13607acf338","Type":"ContainerStarted","Data":"6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22"}
Jul 23 18:05:49.034404 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:49.034347    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8wkvg" podStartSLOduration=1.507214031 podStartE2EDuration="5.034332443s" totalImagesPullingTime="3.527118412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:49.033245124 +0000 UTC m=+490.865936283" watchObservedRunningTime="2026-07-23 18:05:49.034332443 +0000 UTC m=+490.867023605"
Jul 23 18:05:49.466715 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:49.466638    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wkvg"]
Jul 23 18:05:51.025479 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:51.025438    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8wkvg" podUID="08a68117-caee-46cb-9483-a13607acf338" containerName="authorino" containerID="cri-o://6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22" gracePeriod=30
Jul 23 18:05:51.266895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:51.266873    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8wkvg"
Jul 23 18:05:51.378885 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:51.378817    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67phq\" (UniqueName: \"kubernetes.io/projected/08a68117-caee-46cb-9483-a13607acf338-kube-api-access-67phq\") pod \"08a68117-caee-46cb-9483-a13607acf338\" (UID: \"08a68117-caee-46cb-9483-a13607acf338\") "
Jul 23 18:05:51.380800 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:51.380772    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08a68117-caee-46cb-9483-a13607acf338-kube-api-access-67phq" (OuterVolumeSpecName: "kube-api-access-67phq") pod "08a68117-caee-46cb-9483-a13607acf338" (UID: "08a68117-caee-46cb-9483-a13607acf338"). InnerVolumeSpecName "kube-api-access-67phq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:05:51.480315 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:51.480284    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67phq\" (UniqueName: \"kubernetes.io/projected/08a68117-caee-46cb-9483-a13607acf338-kube-api-access-67phq\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:05:52.031924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.031891    2572 generic.go:356] "Generic (PLEG): container finished" podID="08a68117-caee-46cb-9483-a13607acf338" containerID="6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22" exitCode=0
Jul 23 18:05:52.031924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.031926    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8wkvg" event={"ID":"08a68117-caee-46cb-9483-a13607acf338","Type":"ContainerDied","Data":"6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22"}
Jul 23 18:05:52.032394 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.031936    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8wkvg"
Jul 23 18:05:52.032394 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.031953    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8wkvg" event={"ID":"08a68117-caee-46cb-9483-a13607acf338","Type":"ContainerDied","Data":"4ade6ba4d29cd3ff76036767f031f6c4ce795f74a963c3d4e94354dd5691f02e"}
Jul 23 18:05:52.032394 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.031970    2572 scope.go:117] "RemoveContainer" containerID="6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22"
Jul 23 18:05:52.040664 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.040648    2572 scope.go:117] "RemoveContainer" containerID="6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22"
Jul 23 18:05:52.040937 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:05:52.040917    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22\": container with ID starting with 6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22 not found: ID does not exist" containerID="6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22"
Jul 23 18:05:52.041009 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.040945    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22"} err="failed to get container status \"6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22\": rpc error: code = NotFound desc = could not find container \"6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22\": container with ID starting with 6b3b7644062009a9d496d0da8dffaf08ec5a142f6d52e04e2bd6a297d6f32c22 not found: ID does not exist"
Jul 23 18:05:52.055358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.055335    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wkvg"]
Jul 23 18:05:52.059644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.059623    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8wkvg"]
Jul 23 18:05:52.792627 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:05:52.792596    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08a68117-caee-46cb-9483-a13607acf338" path="/var/lib/kubelet/pods/08a68117-caee-46cb-9483-a13607acf338/volumes"
Jul 23 18:06:18.104732 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.104698    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tlqkm"]
Jul 23 18:06:18.105259 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.105238    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08a68117-caee-46cb-9483-a13607acf338" containerName="authorino"
Jul 23 18:06:18.105305 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.105263    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="08a68117-caee-46cb-9483-a13607acf338" containerName="authorino"
Jul 23 18:06:18.105349 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.105344    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="08a68117-caee-46cb-9483-a13607acf338" containerName="authorino"
Jul 23 18:06:18.110265 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.110246    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tlqkm"
Jul 23 18:06:18.114243 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.114214    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lvr5d\""
Jul 23 18:06:18.116971 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.116948    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tlqkm"]
Jul 23 18:06:18.209534 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.209508    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr5cn\" (UniqueName: \"kubernetes.io/projected/459915f4-a304-4da9-b19a-dfb7ea294f16-kube-api-access-lr5cn\") pod \"authorino-5d4b67c446-tlqkm\" (UID: \"459915f4-a304-4da9-b19a-dfb7ea294f16\") " pod="kuadrant-system/authorino-5d4b67c446-tlqkm"
Jul 23 18:06:18.310521 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.310481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr5cn\" (UniqueName: \"kubernetes.io/projected/459915f4-a304-4da9-b19a-dfb7ea294f16-kube-api-access-lr5cn\") pod \"authorino-5d4b67c446-tlqkm\" (UID: \"459915f4-a304-4da9-b19a-dfb7ea294f16\") " pod="kuadrant-system/authorino-5d4b67c446-tlqkm"
Jul 23 18:06:18.322281 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.322248    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr5cn\" (UniqueName: \"kubernetes.io/projected/459915f4-a304-4da9-b19a-dfb7ea294f16-kube-api-access-lr5cn\") pod \"authorino-5d4b67c446-tlqkm\" (UID: \"459915f4-a304-4da9-b19a-dfb7ea294f16\") " pod="kuadrant-system/authorino-5d4b67c446-tlqkm"
Jul 23 18:06:18.377971 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.377886    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tlqkm"]
Jul 23 18:06:18.378135 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.378122    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tlqkm"
Jul 23 18:06:18.418598 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.418563    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69d9c5cb4c-tth5b"]
Jul 23 18:06:18.422937 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.422912    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69d9c5cb4c-tth5b"
Jul 23 18:06:18.432393 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.432332    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69d9c5cb4c-tth5b"]
Jul 23 18:06:18.460779 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.460738    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69d9c5cb4c-tth5b"]
Jul 23 18:06:18.461015 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:06:18.460996    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8blhr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-69d9c5cb4c-tth5b" podUID="f588dd11-51bc-46b0-a223-d8df4c2fca31"
Jul 23 18:06:18.512361 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.512324    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8blhr\" (UniqueName: \"kubernetes.io/projected/f588dd11-51bc-46b0-a223-d8df4c2fca31-kube-api-access-8blhr\") pod \"authorino-69d9c5cb4c-tth5b\" (UID: \"f588dd11-51bc-46b0-a223-d8df4c2fca31\") " pod="kuadrant-system/authorino-69d9c5cb4c-tth5b"
Jul 23 18:06:18.523515 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.523492    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7df4cc7987-zlvll"]
Jul 23 18:06:18.526882 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.526867    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:06:18.527252 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.527229    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tlqkm"]
Jul 23 18:06:18.529062 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:06:18.529041    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod459915f4_a304_4da9_b19a_dfb7ea294f16.slice/crio-fb7b9841aff8f306fb619ca4c8cc8f088b51227a9920bbffa8e809b9fe1c897a WatchSource:0}: Error finding container fb7b9841aff8f306fb619ca4c8cc8f088b51227a9920bbffa8e809b9fe1c897a: Status 404 returned error can't find the container with id fb7b9841aff8f306fb619ca4c8cc8f088b51227a9920bbffa8e809b9fe1c897a
Jul 23 18:06:18.533208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.533187    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 18:06:18.545160 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.545139    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7df4cc7987-zlvll"]
Jul 23 18:06:18.613079 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.613050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbpgg\" (UniqueName: \"kubernetes.io/projected/e881c8e1-b2f5-463f-ab04-40045c69349f-kube-api-access-vbpgg\") pod \"authorino-7df4cc7987-zlvll\" (UID: \"e881c8e1-b2f5-463f-ab04-40045c69349f\") " pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:06:18.613216 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.613108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8blhr\" (UniqueName: \"kubernetes.io/projected/f588dd11-51bc-46b0-a223-d8df4c2fca31-kube-api-access-8blhr\") pod \"authorino-69d9c5cb4c-tth5b\" (UID: \"f588dd11-51bc-46b0-a223-d8df4c2fca31\") " pod="kuadrant-system/authorino-69d9c5cb4c-tth5b"
Jul 23 18:06:18.613216 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.613126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e881c8e1-b2f5-463f-ab04-40045c69349f-tls-cert\") pod \"authorino-7df4cc7987-zlvll\" (UID: \"e881c8e1-b2f5-463f-ab04-40045c69349f\") " pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:06:18.622063 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.622036    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8blhr\" (UniqueName: \"kubernetes.io/projected/f588dd11-51bc-46b0-a223-d8df4c2fca31-kube-api-access-8blhr\") pod \"authorino-69d9c5cb4c-tth5b\" (UID: \"f588dd11-51bc-46b0-a223-d8df4c2fca31\") " pod="kuadrant-system/authorino-69d9c5cb4c-tth5b"
Jul 23 18:06:18.713773 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.713699    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbpgg\" (UniqueName: \"kubernetes.io/projected/e881c8e1-b2f5-463f-ab04-40045c69349f-kube-api-access-vbpgg\") pod \"authorino-7df4cc7987-zlvll\" (UID: \"e881c8e1-b2f5-463f-ab04-40045c69349f\") " pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:06:18.713867 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.713771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e881c8e1-b2f5-463f-ab04-40045c69349f-tls-cert\") pod \"authorino-7df4cc7987-zlvll\" (UID: \"e881c8e1-b2f5-463f-ab04-40045c69349f\") " pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:06:18.715847 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.715831    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e881c8e1-b2f5-463f-ab04-40045c69349f-tls-cert\") pod \"authorino-7df4cc7987-zlvll\" (UID: \"e881c8e1-b2f5-463f-ab04-40045c69349f\") " pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:06:18.723482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.723467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbpgg\" (UniqueName: \"kubernetes.io/projected/e881c8e1-b2f5-463f-ab04-40045c69349f-kube-api-access-vbpgg\") pod \"authorino-7df4cc7987-zlvll\" (UID: \"e881c8e1-b2f5-463f-ab04-40045c69349f\") " pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:06:18.843550 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.843526    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:06:18.981150 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:18.981125    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7df4cc7987-zlvll"]
Jul 23 18:06:18.983394 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:06:18.983365    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode881c8e1_b2f5_463f_ab04_40045c69349f.slice/crio-9bcef39967738debd218e663442ba35abed234daa0362c4e7c91f8585bcb111a WatchSource:0}: Error finding container 9bcef39967738debd218e663442ba35abed234daa0362c4e7c91f8585bcb111a: Status 404 returned error can't find the container with id 9bcef39967738debd218e663442ba35abed234daa0362c4e7c91f8585bcb111a
Jul 23 18:06:19.162446 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:19.162407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tlqkm" event={"ID":"459915f4-a304-4da9-b19a-dfb7ea294f16","Type":"ContainerStarted","Data":"fb7b9841aff8f306fb619ca4c8cc8f088b51227a9920bbffa8e809b9fe1c897a"}
Jul 23 18:06:19.163594 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:19.163572    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69d9c5cb4c-tth5b"
Jul 23 18:06:19.163708 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:19.163576    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7df4cc7987-zlvll" event={"ID":"e881c8e1-b2f5-463f-ab04-40045c69349f","Type":"ContainerStarted","Data":"9bcef39967738debd218e663442ba35abed234daa0362c4e7c91f8585bcb111a"}
Jul 23 18:06:19.170994 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:19.170971    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69d9c5cb4c-tth5b"
Jul 23 18:06:19.319492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:19.319466    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8blhr\" (UniqueName: \"kubernetes.io/projected/f588dd11-51bc-46b0-a223-d8df4c2fca31-kube-api-access-8blhr\") pod \"f588dd11-51bc-46b0-a223-d8df4c2fca31\" (UID: \"f588dd11-51bc-46b0-a223-d8df4c2fca31\") "
Jul 23 18:06:19.321794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:19.321769    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f588dd11-51bc-46b0-a223-d8df4c2fca31-kube-api-access-8blhr" (OuterVolumeSpecName: "kube-api-access-8blhr") pod "f588dd11-51bc-46b0-a223-d8df4c2fca31" (UID: "f588dd11-51bc-46b0-a223-d8df4c2fca31"). InnerVolumeSpecName "kube-api-access-8blhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:06:19.420332 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:19.420304    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8blhr\" (UniqueName: \"kubernetes.io/projected/f588dd11-51bc-46b0-a223-d8df4c2fca31-kube-api-access-8blhr\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:06:20.170914 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.170870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tlqkm" event={"ID":"459915f4-a304-4da9-b19a-dfb7ea294f16","Type":"ContainerStarted","Data":"2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707"}
Jul 23 18:06:20.171607 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.170941    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-tlqkm" podUID="459915f4-a304-4da9-b19a-dfb7ea294f16" containerName="authorino" containerID="cri-o://2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707" gracePeriod=30
Jul 23 18:06:20.172387 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.172360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7df4cc7987-zlvll" event={"ID":"e881c8e1-b2f5-463f-ab04-40045c69349f","Type":"ContainerStarted","Data":"9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc"}
Jul 23 18:06:20.172491 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.172390    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69d9c5cb4c-tth5b"
Jul 23 18:06:20.202797 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.202728    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-tlqkm" podStartSLOduration=1.043150788 podStartE2EDuration="2.202710612s" totalImagesPullingTime="1.159559824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:20.202588182 +0000 UTC m=+522.035279360" watchObservedRunningTime="2026-07-23 18:06:20.202710612 +0000 UTC m=+522.035401768"
Jul 23 18:06:20.309288 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.309214    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7df4cc7987-zlvll" podStartSLOduration=1.972759031 podStartE2EDuration="2.309192337s" totalImagesPullingTime="336.433306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:20.250154862 +0000 UTC m=+522.082846020" watchObservedRunningTime="2026-07-23 18:06:20.309192337 +0000 UTC m=+522.141883499"
Jul 23 18:06:20.331485 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.331454    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69d9c5cb4c-tth5b"]
Jul 23 18:06:20.337147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.337123    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69d9c5cb4c-tth5b"]
Jul 23 18:06:20.420104 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.420078    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tlqkm"
Jul 23 18:06:20.530990 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.530961    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr5cn\" (UniqueName: \"kubernetes.io/projected/459915f4-a304-4da9-b19a-dfb7ea294f16-kube-api-access-lr5cn\") pod \"459915f4-a304-4da9-b19a-dfb7ea294f16\" (UID: \"459915f4-a304-4da9-b19a-dfb7ea294f16\") "
Jul 23 18:06:20.533137 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.533108    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459915f4-a304-4da9-b19a-dfb7ea294f16-kube-api-access-lr5cn" (OuterVolumeSpecName: "kube-api-access-lr5cn") pod "459915f4-a304-4da9-b19a-dfb7ea294f16" (UID: "459915f4-a304-4da9-b19a-dfb7ea294f16"). InnerVolumeSpecName "kube-api-access-lr5cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:06:20.631985 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.631947    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr5cn\" (UniqueName: \"kubernetes.io/projected/459915f4-a304-4da9-b19a-dfb7ea294f16-kube-api-access-lr5cn\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:06:20.793660 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:20.793583    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f588dd11-51bc-46b0-a223-d8df4c2fca31" path="/var/lib/kubelet/pods/f588dd11-51bc-46b0-a223-d8df4c2fca31/volumes"
Jul 23 18:06:21.179102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.179020    2572 generic.go:356] "Generic (PLEG): container finished" podID="459915f4-a304-4da9-b19a-dfb7ea294f16" containerID="2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707" exitCode=0
Jul 23 18:06:21.179102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.179063    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tlqkm"
Jul 23 18:06:21.179563 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.179099    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tlqkm" event={"ID":"459915f4-a304-4da9-b19a-dfb7ea294f16","Type":"ContainerDied","Data":"2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707"}
Jul 23 18:06:21.179563 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.179137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tlqkm" event={"ID":"459915f4-a304-4da9-b19a-dfb7ea294f16","Type":"ContainerDied","Data":"fb7b9841aff8f306fb619ca4c8cc8f088b51227a9920bbffa8e809b9fe1c897a"}
Jul 23 18:06:21.179563 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.179153    2572 scope.go:117] "RemoveContainer" containerID="2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707"
Jul 23 18:06:21.187446 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.187434    2572 scope.go:117] "RemoveContainer" containerID="2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707"
Jul 23 18:06:21.187683 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:06:21.187667    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707\": container with ID starting with 2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707 not found: ID does not exist" containerID="2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707"
Jul 23 18:06:21.187728 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.187688    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707"} err="failed to get container status \"2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707\": rpc error: code = NotFound desc = could not find container \"2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707\": container with ID starting with 2b95d727adf735b11f58ab68cba18fd4ffa0873510a4c73fb23a0bacd5366707 not found: ID does not exist"
Jul 23 18:06:21.204500 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.204482    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tlqkm"]
Jul 23 18:06:21.210197 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:21.210179    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tlqkm"]
Jul 23 18:06:22.792441 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:06:22.792411    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="459915f4-a304-4da9-b19a-dfb7ea294f16" path="/var/lib/kubelet/pods/459915f4-a304-4da9-b19a-dfb7ea294f16/volumes"
Jul 23 18:07:10.428695 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:10.428614    2572 generic.go:356] "Generic (PLEG): container finished" podID="3116235e-a0d6-433d-9fd7-946f894ae721" containerID="9fc3698e29b09665f703bcd7e0831291fb5c5f7761ded582657162c8bc453be5" exitCode=0
Jul 23 18:07:10.429109 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:10.428688    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" event={"ID":"3116235e-a0d6-433d-9fd7-946f894ae721","Type":"ContainerDied","Data":"9fc3698e29b09665f703bcd7e0831291fb5c5f7761ded582657162c8bc453be5"}
Jul 23 18:07:10.429109 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:10.429100    2572 scope.go:117] "RemoveContainer" containerID="9fc3698e29b09665f703bcd7e0831291fb5c5f7761ded582657162c8bc453be5"
Jul 23 18:07:10.430079 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:10.430049    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:07:10.430185 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:10.430133    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:07:10.430249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:10.430193    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:07:11.439389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:11.439344    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" event={"ID":"3116235e-a0d6-433d-9fd7-946f894ae721","Type":"ContainerStarted","Data":"75ee5924a7634ec8a14a0f7b44ab399eda7bbc6bd4e95e58115b5590698825a4"}
Jul 23 18:07:11.622369 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:11.622342    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:07:11.623487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:11.623463    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zv9kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 18:07:11.623578 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:11.623518    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" podUID="3116235e-a0d6-433d-9fd7-946f894ae721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 18:07:12.622524 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:12.622489    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zv9kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 18:07:12.622911 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:12.622544    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" podUID="3116235e-a0d6-433d-9fd7-946f894ae721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 18:07:12.980329 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:12.980250    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:07:13.623142 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:13.623106    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zv9kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 18:07:13.623509 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:13.623161    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" podUID="3116235e-a0d6-433d-9fd7-946f894ae721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 18:07:14.622772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:14.622723    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zv9kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 18:07:14.622941 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:14.622796    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz" podUID="3116235e-a0d6-433d-9fd7-946f894ae721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 18:07:15.625568 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:15.625536    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:07:15.626491 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:15.626469    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zv9kz"
Jul 23 18:07:16.707503 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.707471    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"]
Jul 23 18:07:16.707893 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.707837    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="459915f4-a304-4da9-b19a-dfb7ea294f16" containerName="authorino"
Jul 23 18:07:16.707893 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.707849    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="459915f4-a304-4da9-b19a-dfb7ea294f16" containerName="authorino"
Jul 23 18:07:16.707964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.707910    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="459915f4-a304-4da9-b19a-dfb7ea294f16" containerName="authorino"
Jul 23 18:07:16.711588 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.711561    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.715076 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.715059    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 18:07:16.716415 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.716399    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 18:07:16.716509 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.716403    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jxkjt\""
Jul 23 18:07:16.716509 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.716402    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 18:07:16.724257 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.724233    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"]
Jul 23 18:07:16.781791 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.781739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e456c12-81e3-44b9-9397-931dddb354ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.781964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.781819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.781964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.781908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlph7\" (UniqueName: \"kubernetes.io/projected/4e456c12-81e3-44b9-9397-931dddb354ed-kube-api-access-rlph7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.781964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.781936    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.782082 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.781969    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.782082 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.782049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.882769 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.882716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.882769 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.882776    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.882978 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.882808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e456c12-81e3-44b9-9397-931dddb354ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.882978 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.882852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.883081 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.883027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlph7\" (UniqueName: \"kubernetes.io/projected/4e456c12-81e3-44b9-9397-931dddb354ed-kube-api-access-rlph7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.883081 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.883070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.883276 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.883247    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.883387 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.883370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.883448 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.883416    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.884981 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.884964    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e456c12-81e3-44b9-9397-931dddb354ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.885416 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.885395    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e456c12-81e3-44b9-9397-931dddb354ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:16.892395 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:16.892363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlph7\" (UniqueName: \"kubernetes.io/projected/4e456c12-81e3-44b9-9397-931dddb354ed-kube-api-access-rlph7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5\" (UID: \"4e456c12-81e3-44b9-9397-931dddb354ed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:17.022568 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:17.022531    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:17.177847 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:17.177824    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"]
Jul 23 18:07:17.179331 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:07:17.179291    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e456c12_81e3_44b9_9397_931dddb354ed.slice/crio-c23a0376ce76254d9ee7c29ff234bbfc3191c8fdeb050ffcd94477269a45ab36 WatchSource:0}: Error finding container c23a0376ce76254d9ee7c29ff234bbfc3191c8fdeb050ffcd94477269a45ab36: Status 404 returned error can't find the container with id c23a0376ce76254d9ee7c29ff234bbfc3191c8fdeb050ffcd94477269a45ab36
Jul 23 18:07:17.479559 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:17.479479    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5" event={"ID":"4e456c12-81e3-44b9-9397-931dddb354ed","Type":"ContainerStarted","Data":"c23a0376ce76254d9ee7c29ff234bbfc3191c8fdeb050ffcd94477269a45ab36"}
Jul 23 18:07:19.489986 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:19.489940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5" event={"ID":"4e456c12-81e3-44b9-9397-931dddb354ed","Type":"ContainerStarted","Data":"85b67701d6912bebed57da640d9e42fe913a59afb929d07c7f676907a8fbf1dd"}
Jul 23 18:07:19.525923 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:19.525867    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5" podStartSLOduration=2.261937139 podStartE2EDuration="3.52585078s" totalImagesPullingTime="1.263913641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:19.525568608 +0000 UTC m=+581.358259766" watchObservedRunningTime="2026-07-23 18:07:19.52585078 +0000 UTC m=+581.358541938"
Jul 23 18:07:27.022691 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:27.022658    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:27.023093 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:27.022717    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:27.035011 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:27.034985    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:27.540790 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:27.540745    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5"
Jul 23 18:07:28.057892 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.057861    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"]
Jul 23 18:07:28.061551 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.061531    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.068014 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.067992    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 23 18:07:28.094199 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.094175    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"]
Jul 23 18:07:28.182771 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.182725    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10448400-5d3a-49c8-9ff1-ebd49675b032-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.182915 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.182775    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9hbj\" (UniqueName: \"kubernetes.io/projected/10448400-5d3a-49c8-9ff1-ebd49675b032-kube-api-access-f9hbj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.182915 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.182806    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.182915 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.182852    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.183082 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.182913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.183082 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.182967    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.283832 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.283803    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10448400-5d3a-49c8-9ff1-ebd49675b032-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.283991 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.283836    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9hbj\" (UniqueName: \"kubernetes.io/projected/10448400-5d3a-49c8-9ff1-ebd49675b032-kube-api-access-f9hbj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.283991 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.283864    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.283991 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.283902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.283991 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.283954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.283991 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.283988    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.284307 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.284280    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.284415 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.284326    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.284415 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.284341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.286257 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.286236    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10448400-5d3a-49c8-9ff1-ebd49675b032-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.286366 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.286350    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10448400-5d3a-49c8-9ff1-ebd49675b032-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.293157 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.293138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9hbj\" (UniqueName: \"kubernetes.io/projected/10448400-5d3a-49c8-9ff1-ebd49675b032-kube-api-access-f9hbj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ffx4z\" (UID: \"10448400-5d3a-49c8-9ff1-ebd49675b032\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.372119 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.372055    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:28.511268 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.511237    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"]
Jul 23 18:07:28.512825 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:07:28.512800    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10448400_5d3a_49c8_9ff1_ebd49675b032.slice/crio-a91933cbd9031ffcfd8e9f31092e5830ec22af8d6a47636c0682365c18d5e6a1 WatchSource:0}: Error finding container a91933cbd9031ffcfd8e9f31092e5830ec22af8d6a47636c0682365c18d5e6a1: Status 404 returned error can't find the container with id a91933cbd9031ffcfd8e9f31092e5830ec22af8d6a47636c0682365c18d5e6a1
Jul 23 18:07:28.536826 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:28.536789    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z" event={"ID":"10448400-5d3a-49c8-9ff1-ebd49675b032","Type":"ContainerStarted","Data":"a91933cbd9031ffcfd8e9f31092e5830ec22af8d6a47636c0682365c18d5e6a1"}
Jul 23 18:07:29.543957 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:29.543922    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z" event={"ID":"10448400-5d3a-49c8-9ff1-ebd49675b032","Type":"ContainerStarted","Data":"d90695788ee5efc833d5f201450a768b87b92b5cbf8735e7f5d5a77930417632"}
Jul 23 18:07:29.575264 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:29.575201    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z" podStartSLOduration=1.3704487890000001 podStartE2EDuration="1.575184704s" totalImagesPullingTime="204.735915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:29.572520071 +0000 UTC m=+591.405211248" watchObservedRunningTime="2026-07-23 18:07:29.575184704 +0000 UTC m=+591.407875861"
Jul 23 18:07:38.373085 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:38.373054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:38.373509 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:38.373321    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:38.385901 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:38.385880    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:07:38.601922 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:07:38.601893    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ffx4z"
Jul 23 18:08:53.390168 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.390130    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7df4cc7987-zlvll"]
Jul 23 18:08:53.390671 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.390340    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7df4cc7987-zlvll" podUID="e881c8e1-b2f5-463f-ab04-40045c69349f" containerName="authorino" containerID="cri-o://9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc" gracePeriod=30
Jul 23 18:08:53.636801 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.636777    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:08:53.695455 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.695380    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbpgg\" (UniqueName: \"kubernetes.io/projected/e881c8e1-b2f5-463f-ab04-40045c69349f-kube-api-access-vbpgg\") pod \"e881c8e1-b2f5-463f-ab04-40045c69349f\" (UID: \"e881c8e1-b2f5-463f-ab04-40045c69349f\") "
Jul 23 18:08:53.695455 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.695444    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e881c8e1-b2f5-463f-ab04-40045c69349f-tls-cert\") pod \"e881c8e1-b2f5-463f-ab04-40045c69349f\" (UID: \"e881c8e1-b2f5-463f-ab04-40045c69349f\") "
Jul 23 18:08:53.697532 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.697501    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e881c8e1-b2f5-463f-ab04-40045c69349f-kube-api-access-vbpgg" (OuterVolumeSpecName: "kube-api-access-vbpgg") pod "e881c8e1-b2f5-463f-ab04-40045c69349f" (UID: "e881c8e1-b2f5-463f-ab04-40045c69349f"). InnerVolumeSpecName "kube-api-access-vbpgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:08:53.705560 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.705529    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e881c8e1-b2f5-463f-ab04-40045c69349f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e881c8e1-b2f5-463f-ab04-40045c69349f" (UID: "e881c8e1-b2f5-463f-ab04-40045c69349f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:08:53.796177 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.796153    2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e881c8e1-b2f5-463f-ab04-40045c69349f-tls-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.796177 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.796175    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbpgg\" (UniqueName: \"kubernetes.io/projected/e881c8e1-b2f5-463f-ab04-40045c69349f-kube-api-access-vbpgg\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.976653 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.976575    2572 generic.go:356] "Generic (PLEG): container finished" podID="e881c8e1-b2f5-463f-ab04-40045c69349f" containerID="9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc" exitCode=0
Jul 23 18:08:53.976653 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.976619    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7df4cc7987-zlvll"
Jul 23 18:08:53.976857 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.976663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7df4cc7987-zlvll" event={"ID":"e881c8e1-b2f5-463f-ab04-40045c69349f","Type":"ContainerDied","Data":"9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc"}
Jul 23 18:08:53.976857 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.976704    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7df4cc7987-zlvll" event={"ID":"e881c8e1-b2f5-463f-ab04-40045c69349f","Type":"ContainerDied","Data":"9bcef39967738debd218e663442ba35abed234daa0362c4e7c91f8585bcb111a"}
Jul 23 18:08:53.976857 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.976723    2572 scope.go:117] "RemoveContainer" containerID="9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc"
Jul 23 18:08:53.985795 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.985775    2572 scope.go:117] "RemoveContainer" containerID="9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc"
Jul 23 18:08:53.986077 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:08:53.986057    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc\": container with ID starting with 9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc not found: ID does not exist" containerID="9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc"
Jul 23 18:08:53.986136 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:53.986085    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc"} err="failed to get container status \"9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc\": rpc error: code = NotFound desc = could not find container \"9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc\": container with ID starting with 9816cf975b2de7736383266d85cc54445aa502e760d0d3d1af5e5f2d2b9ff2bc not found: ID does not exist"
Jul 23 18:08:54.005737 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:54.005715    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7df4cc7987-zlvll"]
Jul 23 18:08:54.013842 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:54.013825    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7df4cc7987-zlvll"]
Jul 23 18:08:54.792797 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:08:54.792738    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e881c8e1-b2f5-463f-ab04-40045c69349f" path="/var/lib/kubelet/pods/e881c8e1-b2f5-463f-ab04-40045c69349f/volumes"
Jul 23 18:12:38.867664 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:12:38.867634    2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/systemd-tmpfiles-clean.service\": RecentStats: unable to find data in memory cache]"
Jul 23 18:15:00.155295 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.155263    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk"]
Jul 23 18:15:00.155802 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.155605    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e881c8e1-b2f5-463f-ab04-40045c69349f" containerName="authorino"
Jul 23 18:15:00.155802 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.155618    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e881c8e1-b2f5-463f-ab04-40045c69349f" containerName="authorino"
Jul 23 18:15:00.155802 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.155682    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e881c8e1-b2f5-463f-ab04-40045c69349f" containerName="authorino"
Jul 23 18:15:00.158895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.158878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk"
Jul 23 18:15:00.161488 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.161472    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:15:00.168184 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.168164    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk"
Jul 23 18:15:00.177622 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.177599    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk"]
Jul 23 18:15:00.303964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.303937    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk"]
Jul 23 18:15:00.305410 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:15:00.305383    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4fcc84_8998_468e_8bdd_cda3d30cf57a.slice/crio-ba45189fa520286a24c0cc4c89184b463a804eea04b88248b3224b116cc42564 WatchSource:0}: Error finding container ba45189fa520286a24c0cc4c89184b463a804eea04b88248b3224b116cc42564: Status 404 returned error can't find the container with id ba45189fa520286a24c0cc4c89184b463a804eea04b88248b3224b116cc42564
Jul 23 18:15:00.307189 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.307171    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:15:00.858093 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:00.858061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk" event={"ID":"6f4fcc84-8998-468e-8bdd-cda3d30cf57a","Type":"ContainerStarted","Data":"ba45189fa520286a24c0cc4c89184b463a804eea04b88248b3224b116cc42564"}
Jul 23 18:15:03.877427 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:03.877392    2572 generic.go:356] "Generic (PLEG): container finished" podID="6f4fcc84-8998-468e-8bdd-cda3d30cf57a" containerID="129631434af762cbdb322c74109e035959ba34aaf33c9840a5be51e189bf11ac" exitCode=0
Jul 23 18:15:03.877843 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:03.877443    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk" event={"ID":"6f4fcc84-8998-468e-8bdd-cda3d30cf57a","Type":"ContainerDied","Data":"129631434af762cbdb322c74109e035959ba34aaf33c9840a5be51e189bf11ac"}
Jul 23 18:15:05.013446 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:05.013419    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk"
Jul 23 18:15:05.889269 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:05.889238    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk"
Jul 23 18:15:05.889448 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:05.889272    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-4xdmk" event={"ID":"6f4fcc84-8998-468e-8bdd-cda3d30cf57a","Type":"ContainerDied","Data":"ba45189fa520286a24c0cc4c89184b463a804eea04b88248b3224b116cc42564"}
Jul 23 18:15:05.889448 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:05.889315    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba45189fa520286a24c0cc4c89184b463a804eea04b88248b3224b116cc42564"
Jul 23 18:15:46.228855 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:46.228766    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"]
Jul 23 18:15:46.229431 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:46.228982    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7" podUID="86ea0b29-1f06-401f-afb2-316017a6bade" containerName="manager" containerID="cri-o://d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9" gracePeriod=10
Jul 23 18:15:49.078277 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.078250    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:15:49.117474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.117440    2572 generic.go:356] "Generic (PLEG): container finished" podID="86ea0b29-1f06-401f-afb2-316017a6bade" containerID="d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9" exitCode=0
Jul 23 18:15:49.117629 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.117475    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7" event={"ID":"86ea0b29-1f06-401f-afb2-316017a6bade","Type":"ContainerDied","Data":"d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9"}
Jul 23 18:15:49.117629 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.117491    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"
Jul 23 18:15:49.117629 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.117531    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7" event={"ID":"86ea0b29-1f06-401f-afb2-316017a6bade","Type":"ContainerDied","Data":"388b901f01d5df88eac63b99fc1caeca18be9d08a6edb94f5ee8250591e4e82d"}
Jul 23 18:15:49.117629 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.117546    2572 scope.go:117] "RemoveContainer" containerID="d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9"
Jul 23 18:15:49.127452 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.127431    2572 scope.go:117] "RemoveContainer" containerID="d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9"
Jul 23 18:15:49.127712 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:15:49.127689    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9\": container with ID starting with d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9 not found: ID does not exist" containerID="d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9"
Jul 23 18:15:49.127806 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.127713    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9"} err="failed to get container status \"d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9\": rpc error: code = NotFound desc = could not find container \"d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9\": container with ID starting with d595d46f2bc868d373f0b5a5bee303a90ed303feb816bc6a1e3b748c4cbf27a9 not found: ID does not exist"
Jul 23 18:15:49.212926 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.212826    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ea0b29-1f06-401f-afb2-316017a6bade-extensions-socket-volume\") pod \"86ea0b29-1f06-401f-afb2-316017a6bade\" (UID: \"86ea0b29-1f06-401f-afb2-316017a6bade\") "
Jul 23 18:15:49.212926 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.212921    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sppms\" (UniqueName: \"kubernetes.io/projected/86ea0b29-1f06-401f-afb2-316017a6bade-kube-api-access-sppms\") pod \"86ea0b29-1f06-401f-afb2-316017a6bade\" (UID: \"86ea0b29-1f06-401f-afb2-316017a6bade\") "
Jul 23 18:15:49.213217 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.213197    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86ea0b29-1f06-401f-afb2-316017a6bade-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "86ea0b29-1f06-401f-afb2-316017a6bade" (UID: "86ea0b29-1f06-401f-afb2-316017a6bade"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:15:49.214958 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.214936    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86ea0b29-1f06-401f-afb2-316017a6bade-kube-api-access-sppms" (OuterVolumeSpecName: "kube-api-access-sppms") pod "86ea0b29-1f06-401f-afb2-316017a6bade" (UID: "86ea0b29-1f06-401f-afb2-316017a6bade"). InnerVolumeSpecName "kube-api-access-sppms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:15:49.314047 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.314021    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ea0b29-1f06-401f-afb2-316017a6bade-extensions-socket-volume\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:15:49.314047 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.314045    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sppms\" (UniqueName: \"kubernetes.io/projected/86ea0b29-1f06-401f-afb2-316017a6bade-kube-api-access-sppms\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:15:49.441191 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.441164    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"]
Jul 23 18:15:49.446647 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:49.446619    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t9wt7"]
Jul 23 18:15:50.792623 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:15:50.792587    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86ea0b29-1f06-401f-afb2-316017a6bade" path="/var/lib/kubelet/pods/86ea0b29-1f06-401f-afb2-316017a6bade/volumes"
Jul 23 18:16:47.410513 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.410479    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"]
Jul 23 18:16:47.410924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.410812    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86ea0b29-1f06-401f-afb2-316017a6bade" containerName="manager"
Jul 23 18:16:47.410924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.410823    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="86ea0b29-1f06-401f-afb2-316017a6bade" containerName="manager"
Jul 23 18:16:47.410924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.410833    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4fcc84-8998-468e-8bdd-cda3d30cf57a" containerName="cleanup"
Jul 23 18:16:47.410924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.410838    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4fcc84-8998-468e-8bdd-cda3d30cf57a" containerName="cleanup"
Jul 23 18:16:47.410924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.410904    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="86ea0b29-1f06-401f-afb2-316017a6bade" containerName="manager"
Jul 23 18:16:47.410924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.410913    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4fcc84-8998-468e-8bdd-cda3d30cf57a" containerName="cleanup"
Jul 23 18:16:47.414212 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.414196    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:47.417058 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.417034    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kmcwq\""
Jul 23 18:16:47.429240 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.429216    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"]
Jul 23 18:16:47.500220 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.500195    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnx6b\" (UniqueName: \"kubernetes.io/projected/de447859-a4a0-4a6f-9e1a-e7d504d51897-kube-api-access-lnx6b\") pod \"kuadrant-operator-controller-manager-86878c769f-8cgfg\" (UID: \"de447859-a4a0-4a6f-9e1a-e7d504d51897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:47.500333 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.500236    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de447859-a4a0-4a6f-9e1a-e7d504d51897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8cgfg\" (UID: \"de447859-a4a0-4a6f-9e1a-e7d504d51897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:47.601487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.601460    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnx6b\" (UniqueName: \"kubernetes.io/projected/de447859-a4a0-4a6f-9e1a-e7d504d51897-kube-api-access-lnx6b\") pod \"kuadrant-operator-controller-manager-86878c769f-8cgfg\" (UID: \"de447859-a4a0-4a6f-9e1a-e7d504d51897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:47.601584 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.601500    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de447859-a4a0-4a6f-9e1a-e7d504d51897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8cgfg\" (UID: \"de447859-a4a0-4a6f-9e1a-e7d504d51897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:47.601887 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.601871    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de447859-a4a0-4a6f-9e1a-e7d504d51897-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8cgfg\" (UID: \"de447859-a4a0-4a6f-9e1a-e7d504d51897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:47.614291 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.614273    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnx6b\" (UniqueName: \"kubernetes.io/projected/de447859-a4a0-4a6f-9e1a-e7d504d51897-kube-api-access-lnx6b\") pod \"kuadrant-operator-controller-manager-86878c769f-8cgfg\" (UID: \"de447859-a4a0-4a6f-9e1a-e7d504d51897\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:47.724475 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.724421    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:47.860278 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:47.860255    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"]
Jul 23 18:16:47.862211 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:16:47.862185    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde447859_a4a0_4a6f_9e1a_e7d504d51897.slice/crio-1d8f86420c5082ee45904cfe15f9ebdfcf6bcc83fdd2daf082d73f113f2e9489 WatchSource:0}: Error finding container 1d8f86420c5082ee45904cfe15f9ebdfcf6bcc83fdd2daf082d73f113f2e9489: Status 404 returned error can't find the container with id 1d8f86420c5082ee45904cfe15f9ebdfcf6bcc83fdd2daf082d73f113f2e9489
Jul 23 18:16:48.431181 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:48.431144    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg" event={"ID":"de447859-a4a0-4a6f-9e1a-e7d504d51897","Type":"ContainerStarted","Data":"8b49c72ef1b55a1b6cb2b930903e9de3f36acb15be0acb6f248a7c1248dd2244"}
Jul 23 18:16:48.431546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:48.431201    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg" event={"ID":"de447859-a4a0-4a6f-9e1a-e7d504d51897","Type":"ContainerStarted","Data":"1d8f86420c5082ee45904cfe15f9ebdfcf6bcc83fdd2daf082d73f113f2e9489"}
Jul 23 18:16:48.431546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:48.431229    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:16:48.463654 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:48.463606    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg" podStartSLOduration=1.463591819 podStartE2EDuration="1.463591819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:48.460347109 +0000 UTC m=+1150.293038266" watchObservedRunningTime="2026-07-23 18:16:48.463591819 +0000 UTC m=+1150.296282977"
Jul 23 18:16:59.438065 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:16:59.438034    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8cgfg"
Jul 23 18:19:42.795545 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.795511    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"]
Jul 23 18:19:42.799421 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.799403    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:42.801822 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.801802    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-cc577869-kserve-self-signed-certs\""
Jul 23 18:19:42.814527 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.814504    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"]
Jul 23 18:19:42.917152 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.917115    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-home\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:42.917342 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.917198    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-dshm\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:42.917342 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.917223    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-tmp-dir\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:42.917342 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.917244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-model-cache\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:42.917342 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.917273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b573f5c-5eab-4801-97a6-e1516ac7330f-tls-certs\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:42.917342 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:42.917325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thnl2\" (UniqueName: \"kubernetes.io/projected/4b573f5c-5eab-4801-97a6-e1516ac7330f-kube-api-access-thnl2\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018117 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018072    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-dshm\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018117 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-tmp-dir\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018137    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-model-cache\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b573f5c-5eab-4801-97a6-e1516ac7330f-tls-certs\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018170    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thnl2\" (UniqueName: \"kubernetes.io/projected/4b573f5c-5eab-4801-97a6-e1516ac7330f-kube-api-access-thnl2\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-home\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018597 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018554    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-model-cache\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018638 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-tmp-dir\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.018683 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.018657    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-home\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.020454 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.020438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-dshm\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.020715 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.020698    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b573f5c-5eab-4801-97a6-e1516ac7330f-tls-certs\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.026365 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.026337    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thnl2\" (UniqueName: \"kubernetes.io/projected/4b573f5c-5eab-4801-97a6-e1516ac7330f-kube-api-access-thnl2\") pod \"e2e-same-id-a-cc577869-kserve-56db969b8c-k462l\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") " pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.107999 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.107917    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:43.244827 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.244723    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"]
Jul 23 18:19:43.247234 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:19:43.247204    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b573f5c_5eab_4801_97a6_e1516ac7330f.slice/crio-0804f624c257b65aacc17e1e9ecc35e3e043882e7c0692a3e24f1d889f31e0a3 WatchSource:0}: Error finding container 0804f624c257b65aacc17e1e9ecc35e3e043882e7c0692a3e24f1d889f31e0a3: Status 404 returned error can't find the container with id 0804f624c257b65aacc17e1e9ecc35e3e043882e7c0692a3e24f1d889f31e0a3
Jul 23 18:19:43.317453 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.317418    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l" event={"ID":"4b573f5c-5eab-4801-97a6-e1516ac7330f","Type":"ContainerStarted","Data":"bfed3a9f40aa05ba9e784f551c9352c8609f294537bf12a8eed9b86539799a41"}
Jul 23 18:19:43.317453 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.317463    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l" event={"ID":"4b573f5c-5eab-4801-97a6-e1516ac7330f","Type":"ContainerStarted","Data":"0804f624c257b65aacc17e1e9ecc35e3e043882e7c0692a3e24f1d889f31e0a3"}
Jul 23 18:19:43.335661 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:43.335606    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l" podStartSLOduration=1.335588892 podStartE2EDuration="1.335588892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:19:43.33396187 +0000 UTC m=+1325.166653040" watchObservedRunningTime="2026-07-23 18:19:43.335588892 +0000 UTC m=+1325.168280091"
Jul 23 18:19:53.108697 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:53.108656    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:53.108697 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:53.108702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:53.121703 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:53.121681    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:19:53.383702 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:19:53.383620    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:20:26.384293 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:26.384218    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"]
Jul 23 18:20:41.405996 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.405924    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l" podUID="4b573f5c-5eab-4801-97a6-e1516ac7330f" containerName="main" containerID="cri-o://bfed3a9f40aa05ba9e784f551c9352c8609f294537bf12a8eed9b86539799a41" gracePeriod=45
Jul 23 18:20:41.621508 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.621477    2572 generic.go:356] "Generic (PLEG): container finished" podID="4b573f5c-5eab-4801-97a6-e1516ac7330f" containerID="bfed3a9f40aa05ba9e784f551c9352c8609f294537bf12a8eed9b86539799a41" exitCode=0
Jul 23 18:20:41.621662 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.621536    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l" event={"ID":"4b573f5c-5eab-4801-97a6-e1516ac7330f","Type":"ContainerDied","Data":"bfed3a9f40aa05ba9e784f551c9352c8609f294537bf12a8eed9b86539799a41"}
Jul 23 18:20:41.671794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.671770    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:20:41.743926 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.743897    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-model-cache\") pod \"4b573f5c-5eab-4801-97a6-e1516ac7330f\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") "
Jul 23 18:20:41.744102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.743940    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-home\") pod \"4b573f5c-5eab-4801-97a6-e1516ac7330f\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") "
Jul 23 18:20:41.744102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.743957    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-dshm\") pod \"4b573f5c-5eab-4801-97a6-e1516ac7330f\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") "
Jul 23 18:20:41.744102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744016    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thnl2\" (UniqueName: \"kubernetes.io/projected/4b573f5c-5eab-4801-97a6-e1516ac7330f-kube-api-access-thnl2\") pod \"4b573f5c-5eab-4801-97a6-e1516ac7330f\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") "
Jul 23 18:20:41.744102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744048    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b573f5c-5eab-4801-97a6-e1516ac7330f-tls-certs\") pod \"4b573f5c-5eab-4801-97a6-e1516ac7330f\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") "
Jul 23 18:20:41.744102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744091    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-tmp-dir\") pod \"4b573f5c-5eab-4801-97a6-e1516ac7330f\" (UID: \"4b573f5c-5eab-4801-97a6-e1516ac7330f\") "
Jul 23 18:20:41.744419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744172    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b573f5c-5eab-4801-97a6-e1516ac7330f" (UID: "4b573f5c-5eab-4801-97a6-e1516ac7330f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:20:41.744419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744189    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-home" (OuterVolumeSpecName: "home") pod "4b573f5c-5eab-4801-97a6-e1516ac7330f" (UID: "4b573f5c-5eab-4801-97a6-e1516ac7330f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:20:41.744419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744340    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b573f5c-5eab-4801-97a6-e1516ac7330f" (UID: "4b573f5c-5eab-4801-97a6-e1516ac7330f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:20:41.744625 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744464    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-tmp-dir\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:20:41.744625 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744491    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-model-cache\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:20:41.744625 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.744500    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-home\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:20:41.746358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.746330    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-dshm" (OuterVolumeSpecName: "dshm") pod "4b573f5c-5eab-4801-97a6-e1516ac7330f" (UID: "4b573f5c-5eab-4801-97a6-e1516ac7330f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:20:41.746358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.746338    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b573f5c-5eab-4801-97a6-e1516ac7330f-kube-api-access-thnl2" (OuterVolumeSpecName: "kube-api-access-thnl2") pod "4b573f5c-5eab-4801-97a6-e1516ac7330f" (UID: "4b573f5c-5eab-4801-97a6-e1516ac7330f"). InnerVolumeSpecName "kube-api-access-thnl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:20:41.746504 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.746385    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b573f5c-5eab-4801-97a6-e1516ac7330f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b573f5c-5eab-4801-97a6-e1516ac7330f" (UID: "4b573f5c-5eab-4801-97a6-e1516ac7330f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:20:41.845093 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.845058    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b573f5c-5eab-4801-97a6-e1516ac7330f-dshm\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:20:41.845093 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.845089    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thnl2\" (UniqueName: \"kubernetes.io/projected/4b573f5c-5eab-4801-97a6-e1516ac7330f-kube-api-access-thnl2\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:20:41.845093 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:41.845099    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b573f5c-5eab-4801-97a6-e1516ac7330f-tls-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:20:42.628285 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:42.628253    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"
Jul 23 18:20:42.628806 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:42.628293    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l" event={"ID":"4b573f5c-5eab-4801-97a6-e1516ac7330f","Type":"ContainerDied","Data":"0804f624c257b65aacc17e1e9ecc35e3e043882e7c0692a3e24f1d889f31e0a3"}
Jul 23 18:20:42.628806 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:42.628347    2572 scope.go:117] "RemoveContainer" containerID="bfed3a9f40aa05ba9e784f551c9352c8609f294537bf12a8eed9b86539799a41"
Jul 23 18:20:42.651171 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:42.651147    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"]
Jul 23 18:20:42.654521 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:42.654494    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-cc577869-kserve-56db969b8c-k462l"]
Jul 23 18:20:42.793020 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:20:42.792990    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b573f5c-5eab-4801-97a6-e1516ac7330f" path="/var/lib/kubelet/pods/4b573f5c-5eab-4801-97a6-e1516ac7330f/volumes"
Jul 23 18:24:10.431360 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.431327    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"]
Jul 23 18:24:10.431931 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.431912    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b573f5c-5eab-4801-97a6-e1516ac7330f" containerName="main"
Jul 23 18:24:10.432016 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.431934    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b573f5c-5eab-4801-97a6-e1516ac7330f" containerName="main"
Jul 23 18:24:10.432073 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.432038    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b573f5c-5eab-4801-97a6-e1516ac7330f" containerName="main"
Jul 23 18:24:10.435099 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.435075    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.437702 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.437677    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e804c486-openshift-default-dockercfg-p4c5m\""
Jul 23 18:24:10.458872 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.458848    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"]
Jul 23 18:24:10.508602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rdvp\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-kube-api-access-5rdvp\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.508602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508607    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-credential-socket\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.508906 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f972ca9e-d654-459f-861e-6a2dae65a0f6-istiod-ca-cert\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.508906 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508768    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-data\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.508906 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-socket\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.508906 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508836    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-podinfo\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.508906 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508865    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-token\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.509095 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508909    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-certs\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.509095 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.508954    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-envoy\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610096 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-token\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610296 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-certs\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610296 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-envoy\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610296 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rdvp\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-kube-api-access-5rdvp\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610296 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610182    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-credential-socket\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610349    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f972ca9e-d654-459f-861e-6a2dae65a0f6-istiod-ca-cert\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-data\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610438    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-socket\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-podinfo\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610666    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-credential-socket\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610704    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-certs\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610785    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-data\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.610829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.610824    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-socket\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.611134 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.611116    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f972ca9e-d654-459f-861e-6a2dae65a0f6-istiod-ca-cert\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.612517 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.612496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-envoy\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.612789 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.612769    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-podinfo\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.618618 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.618596    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-token\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.618864 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.618847    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rdvp\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-kube-api-access-5rdvp\") pod \"e2e-ait-e804c486-openshift-default-5678d684d7-cctvh\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") " pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.745933 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.745838    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:10.889014 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.888985    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"]
Jul 23 18:24:10.890656 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:24:10.890629    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf972ca9e_d654_459f_861e_6a2dae65a0f6.slice/crio-0948c077a6d349584f6f2d76d5884727b43c561c4f6e1c038200fd5f179c8d21 WatchSource:0}: Error finding container 0948c077a6d349584f6f2d76d5884727b43c561c4f6e1c038200fd5f179c8d21: Status 404 returned error can't find the container with id 0948c077a6d349584f6f2d76d5884727b43c561c4f6e1c038200fd5f179c8d21
Jul 23 18:24:10.893032 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.892998    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:10.893105 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.893068    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:10.893105 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:10.893098    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:11.677728 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:11.677692    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" event={"ID":"f972ca9e-d654-459f-861e-6a2dae65a0f6","Type":"ContainerStarted","Data":"5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8"}
Jul 23 18:24:11.678157 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:11.677766    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" event={"ID":"f972ca9e-d654-459f-861e-6a2dae65a0f6","Type":"ContainerStarted","Data":"0948c077a6d349584f6f2d76d5884727b43c561c4f6e1c038200fd5f179c8d21"}
Jul 23 18:24:11.701135 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:11.701084    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" podStartSLOduration=1.701069709 podStartE2EDuration="1.701069709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:24:11.699077943 +0000 UTC m=+1593.531769101" watchObservedRunningTime="2026-07-23 18:24:11.701069709 +0000 UTC m=+1593.533760867"
Jul 23 18:24:11.746711 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:11.746677    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:11.751618 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:11.751592    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:12.682773 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:12.682713    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:12.683699 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:12.683684    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:27.683887 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:27.683785    2572 patch_prober.go:28] interesting pod/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 23 18:24:27.683887 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:27.683853    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 23 18:24:27.767227 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:27.767192    2572 generic.go:356] "Generic (PLEG): container finished" podID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerID="5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8" exitCode=0
Jul 23 18:24:27.767390 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:27.767256    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" event={"ID":"f972ca9e-d654-459f-861e-6a2dae65a0f6","Type":"ContainerDied","Data":"5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8"}
Jul 23 18:24:27.767680 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:27.767657    2572 scope.go:117] "RemoveContainer" containerID="5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8"
Jul 23 18:24:27.768659 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:27.768632    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:27.768715 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:27.768700    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:27.768768 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:27.768731    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:28.774581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:28.774549    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" event={"ID":"f972ca9e-d654-459f-861e-6a2dae65a0f6","Type":"ContainerStarted","Data":"84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250"}
Jul 23 18:24:29.746709 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:29.746663    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:29.747030 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:29.746744    2572 patch_prober.go:28] interesting pod/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 23 18:24:29.747239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:29.747203    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 23 18:24:30.746888 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:30.746841    2572 patch_prober.go:28] interesting pod/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 23 18:24:30.747424 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:30.746911    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 23 18:24:31.747235 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:31.747200    2572 patch_prober.go:28] interesting pod/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 23 18:24:31.747840 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:31.747805    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 23 18:24:32.750454 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:32.750422    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:32.750937 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:32.750805    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:32.751394 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:32.751373    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:38.857194 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:38.857163    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"]
Jul 23 18:24:38.861047 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:38.861031    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"
Jul 23 18:24:38.863693 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:38.863672    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:24:38.863846 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:38.863719    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:24:38.868666 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:38.868429    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"]
Jul 23 18:24:38.961829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:38.961800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e2f151-3e43-408c-a748-2e2c8ddcedf3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e804c486-trxrd\" (UID: \"37e2f151-3e43-408c-a748-2e2c8ddcedf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"
Jul 23 18:24:39.062912 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:39.062887    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e2f151-3e43-408c-a748-2e2c8ddcedf3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e804c486-trxrd\" (UID: \"37e2f151-3e43-408c-a748-2e2c8ddcedf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"
Jul 23 18:24:39.063458 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:39.063438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e2f151-3e43-408c-a748-2e2c8ddcedf3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e804c486-trxrd\" (UID: \"37e2f151-3e43-408c-a748-2e2c8ddcedf3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"
Jul 23 18:24:39.173062 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:39.172994    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"
Jul 23 18:24:39.301173 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:39.301149    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"]
Jul 23 18:24:39.302786 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:24:39.302717    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e2f151_3e43_408c_a748_2e2c8ddcedf3.slice/crio-55f92b77d63c89e77baab165068796c6e0d40204a028a874a8ab44d4025205a6 WatchSource:0}: Error finding container 55f92b77d63c89e77baab165068796c6e0d40204a028a874a8ab44d4025205a6: Status 404 returned error can't find the container with id 55f92b77d63c89e77baab165068796c6e0d40204a028a874a8ab44d4025205a6
Jul 23 18:24:39.833418 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:39.833331    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd" event={"ID":"37e2f151-3e43-408c-a748-2e2c8ddcedf3","Type":"ContainerStarted","Data":"88d9a056c12ea3c913765e97e25dd4a5540f6a39d52584aefaa3769db42f0992"}
Jul 23 18:24:39.833418 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:39.833382    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd" event={"ID":"37e2f151-3e43-408c-a748-2e2c8ddcedf3","Type":"ContainerStarted","Data":"55f92b77d63c89e77baab165068796c6e0d40204a028a874a8ab44d4025205a6"}
Jul 23 18:24:39.851076 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:39.851029    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd" podStartSLOduration=1.851015048 podStartE2EDuration="1.851015048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:24:39.849841922 +0000 UTC m=+1621.682533074" watchObservedRunningTime="2026-07-23 18:24:39.851015048 +0000 UTC m=+1621.683706206"
Jul 23 18:24:40.844989 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:40.844954    2572 generic.go:356] "Generic (PLEG): container finished" podID="37e2f151-3e43-408c-a748-2e2c8ddcedf3" containerID="88d9a056c12ea3c913765e97e25dd4a5540f6a39d52584aefaa3769db42f0992" exitCode=0
Jul 23 18:24:40.845345 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:40.845034    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd" event={"ID":"37e2f151-3e43-408c-a748-2e2c8ddcedf3","Type":"ContainerDied","Data":"88d9a056c12ea3c913765e97e25dd4a5540f6a39d52584aefaa3769db42f0992"}
Jul 23 18:24:41.975474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:41.975452    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"
Jul 23 18:24:41.982977 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:41.982957    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e2f151-3e43-408c-a748-2e2c8ddcedf3-maas-api-service-ca\") pod \"37e2f151-3e43-408c-a748-2e2c8ddcedf3\" (UID: \"37e2f151-3e43-408c-a748-2e2c8ddcedf3\") "
Jul 23 18:24:41.983281 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:41.983259    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37e2f151-3e43-408c-a748-2e2c8ddcedf3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "37e2f151-3e43-408c-a748-2e2c8ddcedf3" (UID: "37e2f151-3e43-408c-a748-2e2c8ddcedf3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:24:42.084288 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:42.084257    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/37e2f151-3e43-408c-a748-2e2c8ddcedf3-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:42.855324 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:42.855300    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"
Jul 23 18:24:42.855477 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:42.855301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd" event={"ID":"37e2f151-3e43-408c-a748-2e2c8ddcedf3","Type":"ContainerDied","Data":"55f92b77d63c89e77baab165068796c6e0d40204a028a874a8ab44d4025205a6"}
Jul 23 18:24:42.855477 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:42.855422    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55f92b77d63c89e77baab165068796c6e0d40204a028a874a8ab44d4025205a6"
Jul 23 18:24:53.937084 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:53.937044    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"]
Jul 23 18:24:53.941264 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:53.941242    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e804c486-trxrd"]
Jul 23 18:24:54.087683 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:54.087649    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"]
Jul 23 18:24:54.087944 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:54.087902    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy" containerID="cri-o://84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250" gracePeriod=30
Jul 23 18:24:54.792300 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:54.792267    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e2f151-3e43-408c-a748-2e2c8ddcedf3" path="/var/lib/kubelet/pods/37e2f151-3e43-408c-a748-2e2c8ddcedf3/volumes"
Jul 23 18:24:55.284061 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.284033    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"]
Jul 23 18:24:55.284561 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.284460    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e2f151-3e43-408c-a748-2e2c8ddcedf3" containerName="revoke-keys"
Jul 23 18:24:55.284561 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.284474    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e2f151-3e43-408c-a748-2e2c8ddcedf3" containerName="revoke-keys"
Jul 23 18:24:55.284561 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.284530    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e2f151-3e43-408c-a748-2e2c8ddcedf3" containerName="revoke-keys"
Jul 23 18:24:55.288684 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.288665    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.291276 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.291258    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d3807a5a-gw-openshift-default-dockercfg-rj29l\""
Jul 23 18:24:55.301339 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.301316    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"]
Jul 23 18:24:55.384210 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384175    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-envoy\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.384210 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384218    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-data\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.384431 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384236    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-podinfo\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.384431 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-token\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.384431 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-socket\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.384431 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-certs\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.384431 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384408    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69302fa3-eb96-408c-b670-ca3c496bbcb5-istiod-ca-cert\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.384627 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njzxq\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-kube-api-access-njzxq\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.384627 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.384483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-credential-socket\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485036 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485004    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njzxq\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-kube-api-access-njzxq\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485036 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-credential-socket\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485279 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-envoy\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485279 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485097    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-data\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485279 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-podinfo\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485279 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-token\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485279 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485183    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-socket\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485279 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485220    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-certs\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485279 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485271    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69302fa3-eb96-408c-b670-ca3c496bbcb5-istiod-ca-cert\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485675 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485485    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-credential-socket\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485675 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485607    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-data\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485823 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485701    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-socket\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.485823 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.485783    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-certs\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.486017 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.486000    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69302fa3-eb96-408c-b670-ca3c496bbcb5-istiod-ca-cert\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.487907 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.487888    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-envoy\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.488120 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.488102    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-podinfo\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.496096 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.496067    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-token\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.496365 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.496345    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njzxq\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-kube-api-access-njzxq\") pod \"e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") " pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.598572 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.598497    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:55.737916 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.737890    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"]
Jul 23 18:24:55.739993 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:24:55.739964    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69302fa3_eb96_408c_b670_ca3c496bbcb5.slice/crio-019385251a069c1f1e39c46aa494cf4d6ea15ce09001f9baf9731b75ee217b93 WatchSource:0}: Error finding container 019385251a069c1f1e39c46aa494cf4d6ea15ce09001f9baf9731b75ee217b93: Status 404 returned error can't find the container with id 019385251a069c1f1e39c46aa494cf4d6ea15ce09001f9baf9731b75ee217b93
Jul 23 18:24:55.742152 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.742117    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:55.742247 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.742198    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:55.742312 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.742246    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:55.919534 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.919442    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" event={"ID":"69302fa3-eb96-408c-b670-ca3c496bbcb5","Type":"ContainerStarted","Data":"55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df"}
Jul 23 18:24:55.919534 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.919494    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" event={"ID":"69302fa3-eb96-408c-b670-ca3c496bbcb5","Type":"ContainerStarted","Data":"019385251a069c1f1e39c46aa494cf4d6ea15ce09001f9baf9731b75ee217b93"}
Jul 23 18:24:55.939690 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:55.939640    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" podStartSLOduration=0.939621487 podStartE2EDuration="939.621487ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:24:55.939335655 +0000 UTC m=+1637.772026837" watchObservedRunningTime="2026-07-23 18:24:55.939621487 +0000 UTC m=+1637.772312640"
Jul 23 18:24:56.599355 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:56.599315    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:56.604104 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:56.604081    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:56.924796 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:56.924707    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:56.925636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:56.925620    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:24:59.340114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.340087    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:59.421214 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421137    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-certs\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421214 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421178    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-socket\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421214 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421208    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-podinfo\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421234    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f972ca9e-d654-459f-861e-6a2dae65a0f6-istiod-ca-cert\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421297    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-data\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421357    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-envoy\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421409    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-token\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421412    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:24:59.421716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421448    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rdvp\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-kube-api-access-5rdvp\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421451    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:24:59.421716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421495    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-credential-socket\") pod \"f972ca9e-d654-459f-861e-6a2dae65a0f6\" (UID: \"f972ca9e-d654-459f-861e-6a2dae65a0f6\") "
Jul 23 18:24:59.421716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421686    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f972ca9e-d654-459f-861e-6a2dae65a0f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:24:59.421716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421707    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.421988 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.421726    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.422048 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.422030    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:24:59.422359 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.422331    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:24:59.423598 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.423563    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:24:59.423598 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.423588    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-kube-api-access-5rdvp" (OuterVolumeSpecName: "kube-api-access-5rdvp") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "kube-api-access-5rdvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:24:59.423716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.423594    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:24:59.423716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.423615    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "f972ca9e-d654-459f-861e-6a2dae65a0f6" (UID: "f972ca9e-d654-459f-861e-6a2dae65a0f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:24:59.522686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.522653    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.522686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.522682    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.522686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.522693    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.522927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.522706    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rdvp\" (UniqueName: \"kubernetes.io/projected/f972ca9e-d654-459f-861e-6a2dae65a0f6-kube-api-access-5rdvp\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.522927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.522720    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f972ca9e-d654-459f-861e-6a2dae65a0f6-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.522927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.522731    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f972ca9e-d654-459f-861e-6a2dae65a0f6-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.522927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.522742    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f972ca9e-d654-459f-861e-6a2dae65a0f6-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:24:59.948295 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.948259    2572 generic.go:356] "Generic (PLEG): container finished" podID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerID="84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250" exitCode=0
Jul 23 18:24:59.948492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.948323    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"
Jul 23 18:24:59.948492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.948351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" event={"ID":"f972ca9e-d654-459f-861e-6a2dae65a0f6","Type":"ContainerDied","Data":"84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250"}
Jul 23 18:24:59.948492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.948406    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh" event={"ID":"f972ca9e-d654-459f-861e-6a2dae65a0f6","Type":"ContainerDied","Data":"0948c077a6d349584f6f2d76d5884727b43c561c4f6e1c038200fd5f179c8d21"}
Jul 23 18:24:59.948492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.948429    2572 scope.go:117] "RemoveContainer" containerID="84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250"
Jul 23 18:24:59.957997 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.957981    2572 scope.go:117] "RemoveContainer" containerID="5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8"
Jul 23 18:24:59.965537 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.965518    2572 scope.go:117] "RemoveContainer" containerID="84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250"
Jul 23 18:24:59.965869 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:24:59.965849    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250\": container with ID starting with 84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250 not found: ID does not exist" containerID="84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250"
Jul 23 18:24:59.965917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.965880    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250"} err="failed to get container status \"84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250\": rpc error: code = NotFound desc = could not find container \"84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250\": container with ID starting with 84b50331a417d3e0964e4b3963653c0cea1306ce3db8288de6380fc6d567b250 not found: ID does not exist"
Jul 23 18:24:59.965917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.965896    2572 scope.go:117] "RemoveContainer" containerID="5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8"
Jul 23 18:24:59.966111 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:24:59.966097    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8\": container with ID starting with 5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8 not found: ID does not exist" containerID="5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8"
Jul 23 18:24:59.966148 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.966115    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8"} err="failed to get container status \"5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8\": rpc error: code = NotFound desc = could not find container \"5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8\": container with ID starting with 5b40da01a5800ce11a7d3b1d24d839407760f28a45f4b6f0b034dfeb5e2ff5b8 not found: ID does not exist"
Jul 23 18:24:59.980368 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.980348    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"]
Jul 23 18:24:59.985150 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:24:59.985131    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e804c486-openshift-default-5678d684d7-cctvh"]
Jul 23 18:25:00.792586 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:00.792555    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" path="/var/lib/kubelet/pods/f972ca9e-d654-459f-861e-6a2dae65a0f6/volumes"
Jul 23 18:25:11.926707 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:11.926668    2572 patch_prober.go:28] interesting pod/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:25:11.927134 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:11.926737    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 18:25:12.013318 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:12.013285    2572 generic.go:356] "Generic (PLEG): container finished" podID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerID="55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df" exitCode=0
Jul 23 18:25:12.013484 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:12.013356    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" event={"ID":"69302fa3-eb96-408c-b670-ca3c496bbcb5","Type":"ContainerDied","Data":"55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df"}
Jul 23 18:25:12.013782 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:12.013743    2572 scope.go:117] "RemoveContainer" containerID="55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df"
Jul 23 18:25:12.014847 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:12.014819    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:12.014917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:12.014902    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:12.014958 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:12.014941    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:13.020977 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:13.020944    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" event={"ID":"69302fa3-eb96-408c-b670-ca3c496bbcb5","Type":"ContainerStarted","Data":"b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf"}
Jul 23 18:25:13.598794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:13.598738    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:25:13.599004 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:13.598982    2572 patch_prober.go:28] interesting pod/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:25:13.599052 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:13.599033    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 18:25:14.599255 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:14.599219    2572 patch_prober.go:28] interesting pod/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:25:14.599687 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:14.599275    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 18:25:15.599607 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:15.599574    2572 patch_prober.go:28] interesting pod/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:25:15.599983 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:15.599624    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 18:25:16.599097 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:16.599061    2572 patch_prober.go:28] interesting pod/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:25:16.599291 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:16.599132    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 18:25:17.602965 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:17.602933    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:25:17.603437 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:17.603317    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:25:17.604000 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:17.603977    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:25:22.522085 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.522051    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"]
Jul 23 18:25:22.522444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.522376    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy"
Jul 23 18:25:22.522444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.522386    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy"
Jul 23 18:25:22.522444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.522407    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy"
Jul 23 18:25:22.522444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.522413    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy"
Jul 23 18:25:22.522607 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.522471    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy"
Jul 23 18:25:22.525887 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.525870    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"
Jul 23 18:25:22.528481 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.528457    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:25:22.528606 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.528463    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:25:22.535729 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.535706    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"]
Jul 23 18:25:22.638267 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.638238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l\" (UID: \"fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"
Jul 23 18:25:22.739034 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.739003    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l\" (UID: \"fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"
Jul 23 18:25:22.739592 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.739574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l\" (UID: \"fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"
Jul 23 18:25:22.836506 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.836441    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"
Jul 23 18:25:22.968208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:22.968183    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"]
Jul 23 18:25:22.969245 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:25:22.969217    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda82dcc_4745_4aa3_8c9a_a9ddcdbbeeac.slice/crio-70f830e93accf1486d2bfae65142cae2b17ff94883c82897201abf9021a5abb5 WatchSource:0}: Error finding container 70f830e93accf1486d2bfae65142cae2b17ff94883c82897201abf9021a5abb5: Status 404 returned error can't find the container with id 70f830e93accf1486d2bfae65142cae2b17ff94883c82897201abf9021a5abb5
Jul 23 18:25:23.081666 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:23.081634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l" event={"ID":"fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac","Type":"ContainerStarted","Data":"70f830e93accf1486d2bfae65142cae2b17ff94883c82897201abf9021a5abb5"}
Jul 23 18:25:24.088123 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:24.088087    2572 generic.go:356] "Generic (PLEG): container finished" podID="fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac" containerID="1b609f25e0709ae44e43e762a442d5f095db3b78d357b3ab29fc2cdcca055b37" exitCode=0
Jul 23 18:25:24.088587 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:24.088176    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l" event={"ID":"fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac","Type":"ContainerDied","Data":"1b609f25e0709ae44e43e762a442d5f095db3b78d357b3ab29fc2cdcca055b37"}
Jul 23 18:25:25.226600 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:25.226581    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"
Jul 23 18:25:25.361924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:25.361851    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac-maas-api-service-ca\") pod \"fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac\" (UID: \"fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac\") "
Jul 23 18:25:25.362223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:25.362204    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac" (UID: "fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:25:25.462740 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:25.462714    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:26.099941 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:26.099914    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"
Jul 23 18:25:26.099941 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:26.099929    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l" event={"ID":"fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac","Type":"ContainerDied","Data":"70f830e93accf1486d2bfae65142cae2b17ff94883c82897201abf9021a5abb5"}
Jul 23 18:25:26.100238 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:26.099973    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70f830e93accf1486d2bfae65142cae2b17ff94883c82897201abf9021a5abb5"
Jul 23 18:25:37.605173 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:37.605129    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"]
Jul 23 18:25:37.609001 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:37.608972    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d3807a5a-wh48l"]
Jul 23 18:25:37.758055 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:37.758019    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"]
Jul 23 18:25:37.758322 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:37.758293    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy" containerID="cri-o://b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf" gracePeriod=30
Jul 23 18:25:38.576400 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.576366    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"]
Jul 23 18:25:38.576853 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.576834    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac" containerName="revoke-keys"
Jul 23 18:25:38.576853 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.576854    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac" containerName="revoke-keys"
Jul 23 18:25:38.577037 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.576967    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac" containerName="revoke-keys"
Jul 23 18:25:38.577037 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.576982    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f972ca9e-d654-459f-861e-6a2dae65a0f6" containerName="istio-proxy"
Jul 23 18:25:38.580227 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.580206    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.582805 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.582786    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5369f610-openshift-default-dockercfg-9b8zt\""
Jul 23 18:25:38.592416 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.592395    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"]
Jul 23 18:25:38.669779 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.669723    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-certs\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.670375 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.670333    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-credential-socket\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.670512 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.670386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-podinfo\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.670512 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.670418    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-socket\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.670512 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.670451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2fgr\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-kube-api-access-b2fgr\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.670690 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.670554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcdcb533-b91e-4fac-886a-eca3597fd90a-istiod-ca-cert\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.670690 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.670602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-token\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.670690 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.670631    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-data\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.670690 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.670681    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-envoy\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.771427 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-credential-socket\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.771427 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771431    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-podinfo\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.771631 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-socket\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.771631 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2fgr\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-kube-api-access-b2fgr\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.771733 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771668    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcdcb533-b91e-4fac-886a-eca3597fd90a-istiod-ca-cert\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.771875 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771841    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-credential-socket\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.771875 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-token\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.772059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771904    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-data\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.772059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771865    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-socket\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.772059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771934    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-envoy\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.772059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.771998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-certs\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.772326 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.772305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-certs\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.772416 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.772366    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcdcb533-b91e-4fac-886a-eca3597fd90a-istiod-ca-cert\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.772416 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.772334    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-data\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.773948 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.773930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-envoy\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.774037 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.773954    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-podinfo\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.779617 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.779597    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-token\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.779883 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.779866    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2fgr\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-kube-api-access-b2fgr\") pod \"e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") " pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:38.794604 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.794585    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac" path="/var/lib/kubelet/pods/fda82dcc-4745-4aa3-8c9a-a9ddcdbbeeac/volumes"
Jul 23 18:25:38.890978 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:38.890912    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:39.236414 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:39.236391    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"]
Jul 23 18:25:39.238191 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:25:39.238166    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdcb533_b91e_4fac_886a_eca3597fd90a.slice/crio-16ec9b905249b1d2401261b9c4946837e115ab69b52ecfcab82e5548ab6eb990 WatchSource:0}: Error finding container 16ec9b905249b1d2401261b9c4946837e115ab69b52ecfcab82e5548ab6eb990: Status 404 returned error can't find the container with id 16ec9b905249b1d2401261b9c4946837e115ab69b52ecfcab82e5548ab6eb990
Jul 23 18:25:39.240124 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:39.240093    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:39.240215 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:39.240157    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:39.240215 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:39.240193    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:40.179390 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:40.179352    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" event={"ID":"bcdcb533-b91e-4fac-886a-eca3597fd90a","Type":"ContainerStarted","Data":"7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794"}
Jul 23 18:25:40.179833 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:40.179433    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" event={"ID":"bcdcb533-b91e-4fac-886a-eca3597fd90a","Type":"ContainerStarted","Data":"16ec9b905249b1d2401261b9c4946837e115ab69b52ecfcab82e5548ab6eb990"}
Jul 23 18:25:40.204147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:40.204100    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" podStartSLOduration=2.204086447 podStartE2EDuration="2.204086447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:25:40.201366859 +0000 UTC m=+1682.034058077" watchObservedRunningTime="2026-07-23 18:25:40.204086447 +0000 UTC m=+1682.036777604"
Jul 23 18:25:40.891546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:40.891508    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:40.896215 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:40.896191    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:41.184543 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:41.184463    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:41.185359 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:41.185341    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:43.015154 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.015132    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:25:43.112015 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.111936    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-envoy\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112015 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.111986    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-podinfo\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112015 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112002    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-certs\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112037    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-token\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112059    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-credential-socket\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112077    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69302fa3-eb96-408c-b670-ca3c496bbcb5-istiod-ca-cert\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112185    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-data\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112223    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-socket\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112277    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njzxq\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-kube-api-access-njzxq\") pod \"69302fa3-eb96-408c-b670-ca3c496bbcb5\" (UID: \"69302fa3-eb96-408c-b670-ca3c496bbcb5\") "
Jul 23 18:25:43.112593 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112401    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:25:43.112593 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112415    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:25:43.112593 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112578    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69302fa3-eb96-408c-b670-ca3c496bbcb5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:25:43.112782 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112619    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:25:43.112782 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112664    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.112782 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112679    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.112782 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.112695    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69302fa3-eb96-408c-b670-ca3c496bbcb5-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.113196 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.113174    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-data" (OuterVolumeSpecName: "istio-data") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:25:43.114296 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.114273    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:25:43.114394 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.114370    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-token" (OuterVolumeSpecName: "istio-token") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:25:43.114592 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.114571    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:25:43.114633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.114607    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-kube-api-access-njzxq" (OuterVolumeSpecName: "kube-api-access-njzxq") pod "69302fa3-eb96-408c-b670-ca3c496bbcb5" (UID: "69302fa3-eb96-408c-b670-ca3c496bbcb5"). InnerVolumeSpecName "kube-api-access-njzxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:25:43.196146 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.196113    2572 generic.go:356] "Generic (PLEG): container finished" podID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerID="b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf" exitCode=0
Jul 23 18:25:43.196295 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.196175    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"
Jul 23 18:25:43.196295 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.196195    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" event={"ID":"69302fa3-eb96-408c-b670-ca3c496bbcb5","Type":"ContainerDied","Data":"b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf"}
Jul 23 18:25:43.196295 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.196246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz" event={"ID":"69302fa3-eb96-408c-b670-ca3c496bbcb5","Type":"ContainerDied","Data":"019385251a069c1f1e39c46aa494cf4d6ea15ce09001f9baf9731b75ee217b93"}
Jul 23 18:25:43.196295 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.196268    2572 scope.go:117] "RemoveContainer" containerID="b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf"
Jul 23 18:25:43.205635 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.205620    2572 scope.go:117] "RemoveContainer" containerID="55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df"
Jul 23 18:25:43.213618 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213601    2572 scope.go:117] "RemoveContainer" containerID="b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf"
Jul 23 18:25:43.213900 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:25:43.213881    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf\": container with ID starting with b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf not found: ID does not exist" containerID="b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf"
Jul 23 18:25:43.213966 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213908    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf"} err="failed to get container status \"b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf\": rpc error: code = NotFound desc = could not find container \"b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf\": container with ID starting with b161729b7749ba71e6cf900c857d5c4b163a9665411bb5ad0f6660c9e18f6dcf not found: ID does not exist"
Jul 23 18:25:43.213966 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213926    2572 scope.go:117] "RemoveContainer" containerID="55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df"
Jul 23 18:25:43.213966 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213934    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.213966 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213950    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.213966 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213959    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njzxq\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-kube-api-access-njzxq\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.214148 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213969    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.214148 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213978    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.214148 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.213985    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69302fa3-eb96-408c-b670-ca3c496bbcb5-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:25:43.214239 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:25:43.214154    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df\": container with ID starting with 55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df not found: ID does not exist" containerID="55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df"
Jul 23 18:25:43.214239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.214172    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df"} err="failed to get container status \"55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df\": rpc error: code = NotFound desc = could not find container \"55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df\": container with ID starting with 55bd8e419492aec7cb80f9122e62b8934bdd358ad64f6095084b6d369f00e5df not found: ID does not exist"
Jul 23 18:25:43.218142 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.218123    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"]
Jul 23 18:25:43.221555 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:43.221537    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d3807a5a-gw-openshift-default-7c99548b87-xntnz"]
Jul 23 18:25:44.792494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:44.792465    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" path="/var/lib/kubelet/pods/69302fa3-eb96-408c-b670-ca3c496bbcb5/volumes"
Jul 23 18:25:55.270828 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:55.270792    2572 generic.go:356] "Generic (PLEG): container finished" podID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerID="7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794" exitCode=0
Jul 23 18:25:55.271275 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:55.270870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" event={"ID":"bcdcb533-b91e-4fac-886a-eca3597fd90a","Type":"ContainerDied","Data":"7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794"}
Jul 23 18:25:55.271275 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:55.271266    2572 scope.go:117] "RemoveContainer" containerID="7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794"
Jul 23 18:25:55.272245 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:55.272218    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:55.272345 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:55.272299    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:55.272345 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:55.272334    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:56.184543 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:56.184509    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:56.278695 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:56.278660    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" event={"ID":"bcdcb533-b91e-4fac-886a-eca3597fd90a","Type":"ContainerStarted","Data":"4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f"}
Jul 23 18:25:56.891523 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:56.891482    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:25:56.892340 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:56.892316    2572 patch_prober.go:28] interesting pod/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 23 18:25:56.892454 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:56.892374    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 23 18:25:57.891593 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:57.891555    2572 patch_prober.go:28] interesting pod/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 23 18:25:57.892019 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:57.891611    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 23 18:25:58.892190 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:58.892156    2572 patch_prober.go:28] interesting pod/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 23 18:25:58.892641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:58.892217    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 23 18:25:59.891472 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:59.891438    2572 patch_prober.go:28] interesting pod/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 23 18:25:59.891649 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:25:59.891527    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 23 18:26:00.895498 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:00.895462    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:26:00.895888 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:00.895871    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:26:00.896421 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:00.896402    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:26:07.507370 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.507336    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"]
Jul 23 18:26:07.507742 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.507684    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy"
Jul 23 18:26:07.507742 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.507696    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy"
Jul 23 18:26:07.507742 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.507707    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy"
Jul 23 18:26:07.507742 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.507713    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy"
Jul 23 18:26:07.507907 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.507792    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy"
Jul 23 18:26:07.510948 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.510931    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"
Jul 23 18:26:07.513505 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.513487    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:26:07.513505 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.513506    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:26:07.518420 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.518116    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"]
Jul 23 18:26:07.637862 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.637827    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c222147-e944-49ff-8475-5829ef8b961c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5369f610-nmt2n\" (UID: \"1c222147-e944-49ff-8475-5829ef8b961c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"
Jul 23 18:26:07.739282 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.739244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c222147-e944-49ff-8475-5829ef8b961c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5369f610-nmt2n\" (UID: \"1c222147-e944-49ff-8475-5829ef8b961c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"
Jul 23 18:26:07.739853 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.739836    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c222147-e944-49ff-8475-5829ef8b961c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5369f610-nmt2n\" (UID: \"1c222147-e944-49ff-8475-5829ef8b961c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"
Jul 23 18:26:07.822477 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.822446    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"
Jul 23 18:26:07.976855 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:07.976829    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"]
Jul 23 18:26:07.977837 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:26:07.977813    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c222147_e944_49ff_8475_5829ef8b961c.slice/crio-ac351934d19771f44e21e50ea26fe361c6c1c1597ceff6f5b642501bde99ea01 WatchSource:0}: Error finding container ac351934d19771f44e21e50ea26fe361c6c1c1597ceff6f5b642501bde99ea01: Status 404 returned error can't find the container with id ac351934d19771f44e21e50ea26fe361c6c1c1597ceff6f5b642501bde99ea01
Jul 23 18:26:08.341219 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:08.341183    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n" event={"ID":"1c222147-e944-49ff-8475-5829ef8b961c","Type":"ContainerStarted","Data":"95413fdb97484bda913f04ada0badd562df777cdda918fde62279287c052edd5"}
Jul 23 18:26:08.341384 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:08.341238    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n" event={"ID":"1c222147-e944-49ff-8475-5829ef8b961c","Type":"ContainerStarted","Data":"ac351934d19771f44e21e50ea26fe361c6c1c1597ceff6f5b642501bde99ea01"}
Jul 23 18:26:08.359827 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:08.359773    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n" podStartSLOduration=1.359742559 podStartE2EDuration="1.359742559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:26:08.358164324 +0000 UTC m=+1710.190855505" watchObservedRunningTime="2026-07-23 18:26:08.359742559 +0000 UTC m=+1710.192433733"
Jul 23 18:26:09.348013 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:09.347973    2572 generic.go:356] "Generic (PLEG): container finished" podID="1c222147-e944-49ff-8475-5829ef8b961c" containerID="95413fdb97484bda913f04ada0badd562df777cdda918fde62279287c052edd5" exitCode=0
Jul 23 18:26:09.348399 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:09.348066    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n" event={"ID":"1c222147-e944-49ff-8475-5829ef8b961c","Type":"ContainerDied","Data":"95413fdb97484bda913f04ada0badd562df777cdda918fde62279287c052edd5"}
Jul 23 18:26:10.485179 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:10.485155    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"
Jul 23 18:26:10.667975 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:10.667884    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c222147-e944-49ff-8475-5829ef8b961c-maas-api-service-ca\") pod \"1c222147-e944-49ff-8475-5829ef8b961c\" (UID: \"1c222147-e944-49ff-8475-5829ef8b961c\") "
Jul 23 18:26:10.668258 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:10.668234    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c222147-e944-49ff-8475-5829ef8b961c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c222147-e944-49ff-8475-5829ef8b961c" (UID: "1c222147-e944-49ff-8475-5829ef8b961c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:26:10.769048 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:10.769016    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c222147-e944-49ff-8475-5829ef8b961c-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:11.359367 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:11.359340    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"
Jul 23 18:26:11.359367 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:11.359351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n" event={"ID":"1c222147-e944-49ff-8475-5829ef8b961c","Type":"ContainerDied","Data":"ac351934d19771f44e21e50ea26fe361c6c1c1597ceff6f5b642501bde99ea01"}
Jul 23 18:26:11.359572 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:11.359397    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac351934d19771f44e21e50ea26fe361c6c1c1597ceff6f5b642501bde99ea01"
Jul 23 18:26:22.589581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:22.589544    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"]
Jul 23 18:26:22.592563 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:22.592540    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5369f610-nmt2n"]
Jul 23 18:26:22.792453 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:22.792421    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c222147-e944-49ff-8475-5829ef8b961c" path="/var/lib/kubelet/pods/1c222147-e944-49ff-8475-5829ef8b961c/volumes"
Jul 23 18:26:23.838848 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:23.838813    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"]
Jul 23 18:26:23.839237 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:23.839058    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy" containerID="cri-o://4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f" gracePeriod=30
Jul 23 18:26:24.654894 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.654865    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"]
Jul 23 18:26:24.655222 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.655210    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c222147-e944-49ff-8475-5829ef8b961c" containerName="revoke-keys"
Jul 23 18:26:24.655273 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.655223    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c222147-e944-49ff-8475-5829ef8b961c" containerName="revoke-keys"
Jul 23 18:26:24.655311 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.655291    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c222147-e944-49ff-8475-5829ef8b961c" containerName="revoke-keys"
Jul 23 18:26:24.655311 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.655302    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69302fa3-eb96-408c-b670-ca3c496bbcb5" containerName="istio-proxy"
Jul 23 18:26:24.658714 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.658694    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.661201 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.661184    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-dbbc2941-openshift-default-dockercfg-2js2v\""
Jul 23 18:26:24.668499 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.668470    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"]
Jul 23 18:26:24.685921 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.685888    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-credential-socket\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.686048 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.685980    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-token\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.686048 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.686033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xpcc\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-kube-api-access-4xpcc\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.686126 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.686058    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-envoy\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.686126 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.686091    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-data\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.686191 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.686130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istiod-ca-cert\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.686191 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.686166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-certs\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.686254 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.686222    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-socket\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.686291 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.686252    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-podinfo\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.786999 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.786959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-socket\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787198 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-podinfo\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787198 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787040    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-credential-socket\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787198 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787097    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-token\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787198 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xpcc\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-kube-api-access-4xpcc\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787198 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787181    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-envoy\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787476 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-data\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787476 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istiod-ca-cert\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787476 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-certs\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787476 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787416    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-socket\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787691 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-credential-socket\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787691 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-certs\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.787691 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.787635    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-data\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.788078 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.788062    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istiod-ca-cert\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.789525 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.789503    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-envoy\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.789968 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.789949    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-podinfo\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.795422 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.795403    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-token\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.795914 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.795894    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xpcc\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-kube-api-access-4xpcc\") pod \"e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") " pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:24.969602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:24.969501    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:25.111581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:25.111552    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"]
Jul 23 18:26:25.113206 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:26:25.113179    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4da2c7d_dc51_4575_85e9_0c71135f2e16.slice/crio-c803bcd2619bd9e677f82d7043abf29c0fc2233d4050a11a7c88757f08eeedca WatchSource:0}: Error finding container c803bcd2619bd9e677f82d7043abf29c0fc2233d4050a11a7c88757f08eeedca: Status 404 returned error can't find the container with id c803bcd2619bd9e677f82d7043abf29c0fc2233d4050a11a7c88757f08eeedca
Jul 23 18:26:25.115220 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:25.115189    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:26:25.115305 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:25.115252    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:26:25.115305 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:25.115279    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:26:25.441970 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:25.441929    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" event={"ID":"c4da2c7d-dc51-4575-85e9-0c71135f2e16","Type":"ContainerStarted","Data":"cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3"}
Jul 23 18:26:25.442134 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:25.441990    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" event={"ID":"c4da2c7d-dc51-4575-85e9-0c71135f2e16","Type":"ContainerStarted","Data":"c803bcd2619bd9e677f82d7043abf29c0fc2233d4050a11a7c88757f08eeedca"}
Jul 23 18:26:25.461100 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:25.461044    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" podStartSLOduration=1.461025261 podStartE2EDuration="1.461025261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:26:25.46022463 +0000 UTC m=+1727.292915788" watchObservedRunningTime="2026-07-23 18:26:25.461025261 +0000 UTC m=+1727.293716420"
Jul 23 18:26:25.969833 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:25.969798    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:26.974529 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:26.974498    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:27.453510 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:27.453481    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:27.454548 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:27.454527    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:29.084350 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.084322    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:26:29.126101 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126033    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-certs\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126101 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126088    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-podinfo\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126313 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126113    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-credential-socket\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126313 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126128    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-socket\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126313 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126148    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-envoy\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126313 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126170    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcdcb533-b91e-4fac-886a-eca3597fd90a-istiod-ca-cert\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126313 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126188    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-data\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126313 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126222    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-token\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126313 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126265    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2fgr\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-kube-api-access-b2fgr\") pod \"bcdcb533-b91e-4fac-886a-eca3597fd90a\" (UID: \"bcdcb533-b91e-4fac-886a-eca3597fd90a\") "
Jul 23 18:26:29.126672 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126379    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:26:29.126672 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126480    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:26:29.126672 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126493    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:26:29.126889 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126687    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.126889 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126707    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.126889 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126723    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.127045 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.126880    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcdcb533-b91e-4fac-886a-eca3597fd90a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:26:29.127361 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.127332    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-data" (OuterVolumeSpecName: "istio-data") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:26:29.128525 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.128494    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-token" (OuterVolumeSpecName: "istio-token") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:26:29.128637 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.128592    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:26:29.128637 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.128626    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-kube-api-access-b2fgr" (OuterVolumeSpecName: "kube-api-access-b2fgr") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "kube-api-access-b2fgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:26:29.128913 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.128879    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bcdcb533-b91e-4fac-886a-eca3597fd90a" (UID: "bcdcb533-b91e-4fac-886a-eca3597fd90a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:26:29.227874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.227845    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.227874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.227869    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.227874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.227878    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcdcb533-b91e-4fac-886a-eca3597fd90a-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.227874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.227886    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.228232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.227894    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.228232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.227902    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2fgr\" (UniqueName: \"kubernetes.io/projected/bcdcb533-b91e-4fac-886a-eca3597fd90a-kube-api-access-b2fgr\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:29.465881 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.465794    2572 generic.go:356] "Generic (PLEG): container finished" podID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerID="4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f" exitCode=0
Jul 23 18:26:29.465881 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.465850    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"
Jul 23 18:26:29.466061 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.465881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" event={"ID":"bcdcb533-b91e-4fac-886a-eca3597fd90a","Type":"ContainerDied","Data":"4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f"}
Jul 23 18:26:29.466061 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.465934    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82" event={"ID":"bcdcb533-b91e-4fac-886a-eca3597fd90a","Type":"ContainerDied","Data":"16ec9b905249b1d2401261b9c4946837e115ab69b52ecfcab82e5548ab6eb990"}
Jul 23 18:26:29.466061 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.465959    2572 scope.go:117] "RemoveContainer" containerID="4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f"
Jul 23 18:26:29.475722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.475705    2572 scope.go:117] "RemoveContainer" containerID="7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794"
Jul 23 18:26:29.483488 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.483471    2572 scope.go:117] "RemoveContainer" containerID="4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f"
Jul 23 18:26:29.483716 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:26:29.483696    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f\": container with ID starting with 4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f not found: ID does not exist" containerID="4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f"
Jul 23 18:26:29.483816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.483725    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f"} err="failed to get container status \"4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f\": rpc error: code = NotFound desc = could not find container \"4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f\": container with ID starting with 4e87429782376c5c6e10dbfd1e29cf5af3f8279ba7193a3ea0448980fc11608f not found: ID does not exist"
Jul 23 18:26:29.483816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.483744    2572 scope.go:117] "RemoveContainer" containerID="7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794"
Jul 23 18:26:29.484016 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:26:29.484001    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794\": container with ID starting with 7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794 not found: ID does not exist" containerID="7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794"
Jul 23 18:26:29.484067 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.484020    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794"} err="failed to get container status \"7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794\": rpc error: code = NotFound desc = could not find container \"7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794\": container with ID starting with 7491e539f32c36d9f3bdee486ba7afcaa56e7e4bd2cab2de1afee9f437adf794 not found: ID does not exist"
Jul 23 18:26:29.489535 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.489516    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"]
Jul 23 18:26:29.492980 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:29.492960    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5369f610-openshift-default-64f5c49f4c-6cw82"]
Jul 23 18:26:30.793303 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:30.793270    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" path="/var/lib/kubelet/pods/bcdcb533-b91e-4fac-886a-eca3597fd90a/volumes"
Jul 23 18:26:38.525646 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:38.525600    2572 generic.go:356] "Generic (PLEG): container finished" podID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerID="cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3" exitCode=0
Jul 23 18:26:38.526080 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:38.525671    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" event={"ID":"c4da2c7d-dc51-4575-85e9-0c71135f2e16","Type":"ContainerDied","Data":"cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3"}
Jul 23 18:26:38.526124 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:38.526091    2572 scope.go:117] "RemoveContainer" containerID="cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3"
Jul 23 18:26:38.527142 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:38.527112    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:26:38.527220 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:38.527177    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:26:38.527220 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:38.527213    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:26:39.536804 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:39.536743    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" event={"ID":"c4da2c7d-dc51-4575-85e9-0c71135f2e16","Type":"ContainerStarted","Data":"35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2"}
Jul 23 18:26:39.970423 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:39.970322    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:39.971474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:39.971452    2572 patch_prober.go:28] interesting pod/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:26:39.971530 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:39.971502    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 23 18:26:40.970855 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:40.970820    2572 patch_prober.go:28] interesting pod/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:26:40.971229 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:40.970873    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 23 18:26:41.970950 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:41.970916    2572 patch_prober.go:28] interesting pod/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:26:41.971334 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:41.970972    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 23 18:26:42.454054 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:42.454018    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:42.970800 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:42.970738    2572 patch_prober.go:28] interesting pod/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:26:42.970969 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:42.970819    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 23 18:26:43.974190 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:43.974160    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:43.975128 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:43.975111    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:26:51.720270 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.720237    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"]
Jul 23 18:26:51.720666 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.720593    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy"
Jul 23 18:26:51.720666 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.720603    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy"
Jul 23 18:26:51.720765 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.720671    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy"
Jul 23 18:26:51.723655 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.723640    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"
Jul 23 18:26:51.726307 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.726280    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:26:51.726447 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.726284    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:26:51.731990 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.731971    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"]
Jul 23 18:26:51.842150 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.842126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11112761-d52f-48b0-9401-7d3e2b97486c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng\" (UID: \"11112761-d52f-48b0-9401-7d3e2b97486c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"
Jul 23 18:26:51.943170 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.943134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11112761-d52f-48b0-9401-7d3e2b97486c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng\" (UID: \"11112761-d52f-48b0-9401-7d3e2b97486c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"
Jul 23 18:26:51.943723 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:51.943700    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11112761-d52f-48b0-9401-7d3e2b97486c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng\" (UID: \"11112761-d52f-48b0-9401-7d3e2b97486c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"
Jul 23 18:26:52.034732 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:52.034707    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"
Jul 23 18:26:52.367530 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:52.367504    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"]
Jul 23 18:26:52.369011 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:26:52.368969    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11112761_d52f_48b0_9401_7d3e2b97486c.slice/crio-41ac7e8087da982007db9bab0b5939910451b98793b145f5ca456ea8b913bcc2 WatchSource:0}: Error finding container 41ac7e8087da982007db9bab0b5939910451b98793b145f5ca456ea8b913bcc2: Status 404 returned error can't find the container with id 41ac7e8087da982007db9bab0b5939910451b98793b145f5ca456ea8b913bcc2
Jul 23 18:26:52.612353 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:52.612318    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng" event={"ID":"11112761-d52f-48b0-9401-7d3e2b97486c","Type":"ContainerStarted","Data":"9a95d37d7b547ac40867def21e3923e47d58e659a774f938ad14f85f99fd0c60"}
Jul 23 18:26:52.612478 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:52.612366    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng" event={"ID":"11112761-d52f-48b0-9401-7d3e2b97486c","Type":"ContainerStarted","Data":"41ac7e8087da982007db9bab0b5939910451b98793b145f5ca456ea8b913bcc2"}
Jul 23 18:26:52.627861 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:52.627743    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng" podStartSLOduration=1.627725563 podStartE2EDuration="1.627725563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:26:52.626941267 +0000 UTC m=+1754.459632444" watchObservedRunningTime="2026-07-23 18:26:52.627725563 +0000 UTC m=+1754.460416722"
Jul 23 18:26:53.618881 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:53.618849    2572 generic.go:356] "Generic (PLEG): container finished" podID="11112761-d52f-48b0-9401-7d3e2b97486c" containerID="9a95d37d7b547ac40867def21e3923e47d58e659a774f938ad14f85f99fd0c60" exitCode=0
Jul 23 18:26:53.619345 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:53.618883    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng" event={"ID":"11112761-d52f-48b0-9401-7d3e2b97486c","Type":"ContainerDied","Data":"9a95d37d7b547ac40867def21e3923e47d58e659a774f938ad14f85f99fd0c60"}
Jul 23 18:26:54.757164 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:54.757143    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"
Jul 23 18:26:54.868961 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:54.868936    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11112761-d52f-48b0-9401-7d3e2b97486c-maas-api-service-ca\") pod \"11112761-d52f-48b0-9401-7d3e2b97486c\" (UID: \"11112761-d52f-48b0-9401-7d3e2b97486c\") "
Jul 23 18:26:54.869255 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:54.869234    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11112761-d52f-48b0-9401-7d3e2b97486c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "11112761-d52f-48b0-9401-7d3e2b97486c" (UID: "11112761-d52f-48b0-9401-7d3e2b97486c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:26:54.970306 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:54.970247    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11112761-d52f-48b0-9401-7d3e2b97486c-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:26:55.632006 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:55.631968    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng" event={"ID":"11112761-d52f-48b0-9401-7d3e2b97486c","Type":"ContainerDied","Data":"41ac7e8087da982007db9bab0b5939910451b98793b145f5ca456ea8b913bcc2"}
Jul 23 18:26:55.632006 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:55.631993    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"
Jul 23 18:26:55.632214 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:26:55.632043    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41ac7e8087da982007db9bab0b5939910451b98793b145f5ca456ea8b913bcc2"
Jul 23 18:27:06.793202 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:06.793170    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"]
Jul 23 18:27:06.794534 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:06.794510    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dbbc2941-dp4ng"]
Jul 23 18:27:06.940670 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:06.940638    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"]
Jul 23 18:27:06.940911 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:06.940873    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy" containerID="cri-o://35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2" gracePeriod=30
Jul 23 18:27:08.792743 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:08.792709    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11112761-d52f-48b0-9401-7d3e2b97486c" path="/var/lib/kubelet/pods/11112761-d52f-48b0-9401-7d3e2b97486c/volumes"
Jul 23 18:27:12.192870 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.192846    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:27:12.204996 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.204934    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-credential-socket\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.204996 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.204964    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-data\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.205160 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205006    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-envoy\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.205160 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205045    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xpcc\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-kube-api-access-4xpcc\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.205160 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205071    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-podinfo\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.205160 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205099    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istiod-ca-cert\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.205160 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205117    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-socket\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.205160 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205143    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-token\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.205468 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205198    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-certs\") pod \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\" (UID: \"c4da2c7d-dc51-4575-85e9-0c71135f2e16\") "
Jul 23 18:27:12.205468 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205220    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:12.205468 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205431    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:12.205468 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205452    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.205686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205628    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:12.205812 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.205773    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:27:12.206025 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.206002    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:12.207294 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.207269    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:27:12.207365 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.207301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:27:12.207495 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.207475    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:27:12.207607 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.207590    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-kube-api-access-4xpcc" (OuterVolumeSpecName: "kube-api-access-4xpcc") pod "c4da2c7d-dc51-4575-85e9-0c71135f2e16" (UID: "c4da2c7d-dc51-4575-85e9-0c71135f2e16"). InnerVolumeSpecName "kube-api-access-4xpcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:27:12.306258 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.306226    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.306258 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.306253    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.306258 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.306262    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.306258 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.306270    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.306535 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.306289    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.306535 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.306297    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.306535 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.306307    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xpcc\" (UniqueName: \"kubernetes.io/projected/c4da2c7d-dc51-4575-85e9-0c71135f2e16-kube-api-access-4xpcc\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.306535 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.306315    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4da2c7d-dc51-4575-85e9-0c71135f2e16-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:27:12.730806 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.730747    2572 generic.go:356] "Generic (PLEG): container finished" podID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerID="35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2" exitCode=0
Jul 23 18:27:12.731011 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.730819    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"
Jul 23 18:27:12.731011 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.730821    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" event={"ID":"c4da2c7d-dc51-4575-85e9-0c71135f2e16","Type":"ContainerDied","Data":"35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2"}
Jul 23 18:27:12.731011 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.730960    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg" event={"ID":"c4da2c7d-dc51-4575-85e9-0c71135f2e16","Type":"ContainerDied","Data":"c803bcd2619bd9e677f82d7043abf29c0fc2233d4050a11a7c88757f08eeedca"}
Jul 23 18:27:12.731011 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.730992    2572 scope.go:117] "RemoveContainer" containerID="35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2"
Jul 23 18:27:12.741201 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.741183    2572 scope.go:117] "RemoveContainer" containerID="cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3"
Jul 23 18:27:12.749202 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.749181    2572 scope.go:117] "RemoveContainer" containerID="35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2"
Jul 23 18:27:12.749497 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:27:12.749476    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2\": container with ID starting with 35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2 not found: ID does not exist" containerID="35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2"
Jul 23 18:27:12.749581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.749504    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2"} err="failed to get container status \"35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2\": rpc error: code = NotFound desc = could not find container \"35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2\": container with ID starting with 35361ecb42bce45dc85676ef7dd0e1295fae7fc42a3464297151af795413daf2 not found: ID does not exist"
Jul 23 18:27:12.749581 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.749522    2572 scope.go:117] "RemoveContainer" containerID="cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3"
Jul 23 18:27:12.749795 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:27:12.749771    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3\": container with ID starting with cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3 not found: ID does not exist" containerID="cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3"
Jul 23 18:27:12.749884 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.749804    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3"} err="failed to get container status \"cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3\": rpc error: code = NotFound desc = could not find container \"cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3\": container with ID starting with cca0499d7c716d5a13213342099b92c5f924d55bbda1badd1499acf7272adcf3 not found: ID does not exist"
Jul 23 18:27:12.753268 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.753245    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"]
Jul 23 18:27:12.757580 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.757561    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-dbbc2941-openshift-default-7cc7664c75-qc7rg"]
Jul 23 18:27:12.797842 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:27:12.797807    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" path="/var/lib/kubelet/pods/c4da2c7d-dc51-4575-85e9-0c71135f2e16/volumes"
Jul 23 18:28:51.068243 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068213    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"]
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068580    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068591    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068597    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11112761-d52f-48b0-9401-7d3e2b97486c" containerName="revoke-keys"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068603    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="11112761-d52f-48b0-9401-7d3e2b97486c" containerName="revoke-keys"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068620    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068625    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068632    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068637    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068686    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068693    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcdcb533-b91e-4fac-886a-eca3597fd90a" containerName="istio-proxy"
Jul 23 18:28:51.068706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.068702    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="11112761-d52f-48b0-9401-7d3e2b97486c" containerName="revoke-keys"
Jul 23 18:28:51.071672 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.071654    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.076010 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.075984    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-35934046-openshift-default-dockercfg-tqqwb\""
Jul 23 18:28:51.124228 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.124201    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"]
Jul 23 18:28:51.189799 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.189746    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-token\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.189958 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.189812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-data\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.189958 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.189857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-podinfo\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.189958 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.189884    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-socket\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.189958 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.189921    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625cfaed-6e3a-497b-a4be-9350549ae3c4-istiod-ca-cert\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.190211 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.189979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-envoy\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.190211 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.190002    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-certs\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.190211 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.190028    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79n5t\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-kube-api-access-79n5t\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.190211 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.190095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-credential-socket\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.290949 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.290914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625cfaed-6e3a-497b-a4be-9350549ae3c4-istiod-ca-cert\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.290968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-envoy\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.290992    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-certs\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291018    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79n5t\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-kube-api-access-79n5t\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291045    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-credential-socket\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-token\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291119    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-data\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291465 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-podinfo\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291465 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291363    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-socket\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291465 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291442    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-credential-socket\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291537    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-data\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291694 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-certs\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.291777 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.291720    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-socket\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.292085 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.292056    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625cfaed-6e3a-497b-a4be-9350549ae3c4-istiod-ca-cert\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.293518 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.293500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-envoy\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.293647 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.293631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-podinfo\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.319398 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.319344    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-token\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.375295 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.375272    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79n5t\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-kube-api-access-79n5t\") pod \"e2e-mt-35934046-openshift-default-6c577578f5-7vjh2\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") " pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.385072 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.385052    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:51.553741 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.553719    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"]
Jul 23 18:28:51.555715 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:28:51.555688    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cfaed_6e3a_497b_a4be_9350549ae3c4.slice/crio-941733a468a2708e21ece928d215db9923ee4f2a0a802925bd0f141fc869fd94 WatchSource:0}: Error finding container 941733a468a2708e21ece928d215db9923ee4f2a0a802925bd0f141fc869fd94: Status 404 returned error can't find the container with id 941733a468a2708e21ece928d215db9923ee4f2a0a802925bd0f141fc869fd94
Jul 23 18:28:51.557923 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.557890    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:28:51.558017 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.557954    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:28:51.558017 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:51.557982    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:28:52.253436 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:52.253397    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" event={"ID":"625cfaed-6e3a-497b-a4be-9350549ae3c4","Type":"ContainerStarted","Data":"58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c"}
Jul 23 18:28:52.253805 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:52.253452    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" event={"ID":"625cfaed-6e3a-497b-a4be-9350549ae3c4","Type":"ContainerStarted","Data":"941733a468a2708e21ece928d215db9923ee4f2a0a802925bd0f141fc869fd94"}
Jul 23 18:28:52.281590 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:52.281546    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" podStartSLOduration=1.28153061 podStartE2EDuration="1.28153061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:28:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:28:52.27919627 +0000 UTC m=+1874.111887458" watchObservedRunningTime="2026-07-23 18:28:52.28153061 +0000 UTC m=+1874.114221767"
Jul 23 18:28:52.386023 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:52.385997    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:52.390522 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:52.390500    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:53.259295 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:53.259264    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:28:53.260385 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:28:53.260361    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:29:06.859056 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:06.859011    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"]
Jul 23 18:29:06.859650 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:06.859628    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4da2c7d-dc51-4575-85e9-0c71135f2e16" containerName="istio-proxy"
Jul 23 18:29:06.862998 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:06.862977    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"
Jul 23 18:29:06.865729 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:06.865698    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:29:06.865869 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:06.865763    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:29:06.872828 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:06.872801    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"]
Jul 23 18:29:06.934887 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:06.934840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a1e5ce-4f74-4f56-9e83-20f0d889175b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-35934046-8mtnq\" (UID: \"27a1e5ce-4f74-4f56-9e83-20f0d889175b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"
Jul 23 18:29:07.035873 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:07.035834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a1e5ce-4f74-4f56-9e83-20f0d889175b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-35934046-8mtnq\" (UID: \"27a1e5ce-4f74-4f56-9e83-20f0d889175b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"
Jul 23 18:29:07.036641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:07.036611    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a1e5ce-4f74-4f56-9e83-20f0d889175b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-35934046-8mtnq\" (UID: \"27a1e5ce-4f74-4f56-9e83-20f0d889175b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"
Jul 23 18:29:07.175724 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:07.175627    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"
Jul 23 18:29:07.349180 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:07.349145    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"]
Jul 23 18:29:07.350063 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:29:07.350025    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a1e5ce_4f74_4f56_9e83_20f0d889175b.slice/crio-e760be54e6ab9f760d49ca953cd36d96c5ad0739ff744d116e5d374ac13a3af0 WatchSource:0}: Error finding container e760be54e6ab9f760d49ca953cd36d96c5ad0739ff744d116e5d374ac13a3af0: Status 404 returned error can't find the container with id e760be54e6ab9f760d49ca953cd36d96c5ad0739ff744d116e5d374ac13a3af0
Jul 23 18:29:08.344920 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:08.344880    2572 generic.go:356] "Generic (PLEG): container finished" podID="27a1e5ce-4f74-4f56-9e83-20f0d889175b" containerID="3bc35943f48cf97cfcb74c8633f914f54e03b2573abe27fdc1691623fd4f1bf9" exitCode=0
Jul 23 18:29:08.345361 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:08.344976    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq" event={"ID":"27a1e5ce-4f74-4f56-9e83-20f0d889175b","Type":"ContainerDied","Data":"3bc35943f48cf97cfcb74c8633f914f54e03b2573abe27fdc1691623fd4f1bf9"}
Jul 23 18:29:08.345361 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:08.345050    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq" event={"ID":"27a1e5ce-4f74-4f56-9e83-20f0d889175b","Type":"ContainerStarted","Data":"e760be54e6ab9f760d49ca953cd36d96c5ad0739ff744d116e5d374ac13a3af0"}
Jul 23 18:29:08.898194 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:08.897173    2572 patch_prober.go:28] interesting pod/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": read tcp 10.134.0.2:55592->10.134.0.58:15021: read: connection reset by peer" start-of-body=
Jul 23 18:29:08.898194 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:08.897232    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": read tcp 10.134.0.2:55592->10.134.0.58:15021: read: connection reset by peer"
Jul 23 18:29:09.352860 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.352823    2572 generic.go:356] "Generic (PLEG): container finished" podID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerID="58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c" exitCode=0
Jul 23 18:29:09.353250 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.352901    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" event={"ID":"625cfaed-6e3a-497b-a4be-9350549ae3c4","Type":"ContainerDied","Data":"58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c"}
Jul 23 18:29:09.353790 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.353393    2572 scope.go:117] "RemoveContainer" containerID="58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c"
Jul 23 18:29:09.354419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.354387    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:29:09.354506 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.354456    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:29:09.354506 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.354491    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:29:09.504814 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.504789    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"
Jul 23 18:29:09.659870 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.659781    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a1e5ce-4f74-4f56-9e83-20f0d889175b-maas-api-service-ca\") pod \"27a1e5ce-4f74-4f56-9e83-20f0d889175b\" (UID: \"27a1e5ce-4f74-4f56-9e83-20f0d889175b\") "
Jul 23 18:29:09.660123 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.660097    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a1e5ce-4f74-4f56-9e83-20f0d889175b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27a1e5ce-4f74-4f56-9e83-20f0d889175b" (UID: "27a1e5ce-4f74-4f56-9e83-20f0d889175b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:29:09.760928 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:09.760892    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a1e5ce-4f74-4f56-9e83-20f0d889175b-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:10.362112 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:10.362072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" event={"ID":"625cfaed-6e3a-497b-a4be-9350549ae3c4","Type":"ContainerStarted","Data":"fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5"}
Jul 23 18:29:10.363318 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:10.363296    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"
Jul 23 18:29:10.363420 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:10.363328    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq" event={"ID":"27a1e5ce-4f74-4f56-9e83-20f0d889175b","Type":"ContainerDied","Data":"e760be54e6ab9f760d49ca953cd36d96c5ad0739ff744d116e5d374ac13a3af0"}
Jul 23 18:29:10.363420 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:10.363368    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e760be54e6ab9f760d49ca953cd36d96c5ad0739ff744d116e5d374ac13a3af0"
Jul 23 18:29:10.385817 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:10.385788    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:29:10.385993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:10.385972    2572 patch_prober.go:28] interesting pod/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 23 18:29:10.386060 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:10.386014    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 23 18:29:11.386352 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:11.386314    2572 patch_prober.go:28] interesting pod/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 23 18:29:11.386778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:11.386378    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 23 18:29:12.385576 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:12.385541    2572 patch_prober.go:28] interesting pod/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 23 18:29:12.385789 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:12.385593    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 23 18:29:13.386115 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:13.386080    2572 patch_prober.go:28] interesting pod/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 23 18:29:13.386511 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:13.386133    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 23 18:29:14.389364 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:14.389334    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:29:14.389868 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:14.389717    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:29:14.390453 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:14.390439    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:29:22.000497 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:22.000458    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"]
Jul 23 18:29:22.008554 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:22.008494    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-35934046-8mtnq"]
Jul 23 18:29:22.792613 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:22.792574    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27a1e5ce-4f74-4f56-9e83-20f0d889175b" path="/var/lib/kubelet/pods/27a1e5ce-4f74-4f56-9e83-20f0d889175b/volumes"
Jul 23 18:29:28.738698 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:28.738658    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"]
Jul 23 18:29:28.739113 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:28.738941    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy" containerID="cri-o://fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5" gracePeriod=30
Jul 23 18:29:29.391994 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:29.391957    2572 patch_prober.go:28] interesting pod/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:29:29.392161 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:29.392008    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:29:33.991642 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:33.991620    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:29:34.074715 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.074673    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-socket\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.074883 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.074744    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-data\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.074883 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.074810    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-token\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.074883 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.074841    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625cfaed-6e3a-497b-a4be-9350549ae3c4-istiod-ca-cert\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.075058 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.074894    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-envoy\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.075058 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.074929    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-podinfo\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.075058 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.074964    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-credential-socket\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.075058 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075016    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-certs\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.075276 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075059    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79n5t\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-kube-api-access-79n5t\") pod \"625cfaed-6e3a-497b-a4be-9350549ae3c4\" (UID: \"625cfaed-6e3a-497b-a4be-9350549ae3c4\") "
Jul 23 18:29:34.075276 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.074959    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:29:34.075276 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075189    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:29:34.075276 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075249    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/625cfaed-6e3a-497b-a4be-9350549ae3c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:29:34.075487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075349    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.075487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075367    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.075487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075380    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625cfaed-6e3a-497b-a4be-9350549ae3c4-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.075487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075415    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:29:34.075839 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.075814    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:29:34.076980 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.076953    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:29:34.077114 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.077067    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:29:34.077322 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.077305    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:29:34.077457 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.077434    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-kube-api-access-79n5t" (OuterVolumeSpecName: "kube-api-access-79n5t") pod "625cfaed-6e3a-497b-a4be-9350549ae3c4" (UID: "625cfaed-6e3a-497b-a4be-9350549ae3c4"). InnerVolumeSpecName "kube-api-access-79n5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:29:34.175927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.175903    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.175927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.175924    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.175927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.175933    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.176111 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.175941    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.176111 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.175949    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79n5t\" (UniqueName: \"kubernetes.io/projected/625cfaed-6e3a-497b-a4be-9350549ae3c4-kube-api-access-79n5t\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.176111 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.175958    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625cfaed-6e3a-497b-a4be-9350549ae3c4-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:29:34.496716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.496626    2572 generic.go:356] "Generic (PLEG): container finished" podID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerID="fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5" exitCode=0
Jul 23 18:29:34.496716 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.496669    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"
Jul 23 18:29:34.496944 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.496716    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" event={"ID":"625cfaed-6e3a-497b-a4be-9350549ae3c4","Type":"ContainerDied","Data":"fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5"}
Jul 23 18:29:34.496944 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.496785    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2" event={"ID":"625cfaed-6e3a-497b-a4be-9350549ae3c4","Type":"ContainerDied","Data":"941733a468a2708e21ece928d215db9923ee4f2a0a802925bd0f141fc869fd94"}
Jul 23 18:29:34.496944 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.496810    2572 scope.go:117] "RemoveContainer" containerID="fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5"
Jul 23 18:29:34.506229 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.506202    2572 scope.go:117] "RemoveContainer" containerID="58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c"
Jul 23 18:29:34.514108 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.514088    2572 scope.go:117] "RemoveContainer" containerID="fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5"
Jul 23 18:29:34.514354 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:29:34.514333    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5\": container with ID starting with fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5 not found: ID does not exist" containerID="fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5"
Jul 23 18:29:34.514439 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.514360    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5"} err="failed to get container status \"fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5\": rpc error: code = NotFound desc = could not find container \"fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5\": container with ID starting with fcb5937c3cdfb9404268b5f098b1771955d82d097bb31ff1b4f1e54452d255e5 not found: ID does not exist"
Jul 23 18:29:34.514439 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.514377    2572 scope.go:117] "RemoveContainer" containerID="58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c"
Jul 23 18:29:34.514581 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:29:34.514567    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c\": container with ID starting with 58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c not found: ID does not exist" containerID="58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c"
Jul 23 18:29:34.514631 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.514584    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c"} err="failed to get container status \"58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c\": rpc error: code = NotFound desc = could not find container \"58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c\": container with ID starting with 58ff2906255018202d43aca1ca46affbd1994f9eabd1bde30419dcde471c803c not found: ID does not exist"
Jul 23 18:29:34.521804 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.521770    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"]
Jul 23 18:29:34.526493 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.526474    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-35934046-openshift-default-6c577578f5-7vjh2"]
Jul 23 18:29:34.793444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:34.793412    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" path="/var/lib/kubelet/pods/625cfaed-6e3a-497b-a4be-9350549ae3c4/volumes"
Jul 23 18:29:48.991931 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.991899    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"]
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992258    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a1e5ce-4f74-4f56-9e83-20f0d889175b" containerName="revoke-keys"
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992271    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a1e5ce-4f74-4f56-9e83-20f0d889175b" containerName="revoke-keys"
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992293    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy"
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992299    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy"
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992309    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy"
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992315    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy"
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992371    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy"
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992379    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="625cfaed-6e3a-497b-a4be-9350549ae3c4" containerName="istio-proxy"
Jul 23 18:29:48.992434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.992387    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a1e5ce-4f74-4f56-9e83-20f0d889175b" containerName="revoke-keys"
Jul 23 18:29:48.995272 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.995255    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:48.998586 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:48.998566    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ec1a268e-openshift-default-dockercfg-jtb9c\""
Jul 23 18:29:49.008095 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.008071    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"]
Jul 23 18:29:49.095977 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.095932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4kcw\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-kube-api-access-f4kcw\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.095977 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.095982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-certs\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.096186 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.096014    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-credential-socket\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.096186 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.096047    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-istio-token\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.096186 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.096065    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-socket\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.096186 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.096095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-envoy\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.096186 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.096160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-data\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.096344 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.096202    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46710f95-1211-403c-b5a5-d769830724c7-istio-podinfo\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.096344 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.096236    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46710f95-1211-403c-b5a5-d769830724c7-istiod-ca-cert\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197144 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-istio-token\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197144 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-socket\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197360 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197164    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-envoy\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197360 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197284    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-data\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197360 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197334    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46710f95-1211-403c-b5a5-d769830724c7-istio-podinfo\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46710f95-1211-403c-b5a5-d769830724c7-istiod-ca-cert\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4kcw\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-kube-api-access-f4kcw\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197486    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-certs\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197649 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197530    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-credential-socket\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197649 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-socket\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197775 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197650    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-data\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197933 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197916    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-credential-socket\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.197998 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.197934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-certs\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.198188 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.198170    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46710f95-1211-403c-b5a5-d769830724c7-istiod-ca-cert\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.199395 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.199373    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-envoy\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.199925 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.199907    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46710f95-1211-403c-b5a5-d769830724c7-istio-podinfo\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.207458 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.207439    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-istio-token\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.208446 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.208423    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4kcw\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-kube-api-access-f4kcw\") pod \"e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") " pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.305204 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.305168    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:49.440053 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.440019    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"]
Jul 23 18:29:49.442958 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:29:49.442931    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46710f95_1211_403c_b5a5_d769830724c7.slice/crio-c62caaf78bacfc3fb9d7489ffdc47961e313f61ce56a6cbc343a246182094d5b WatchSource:0}: Error finding container c62caaf78bacfc3fb9d7489ffdc47961e313f61ce56a6cbc343a246182094d5b: Status 404 returned error can't find the container with id c62caaf78bacfc3fb9d7489ffdc47961e313f61ce56a6cbc343a246182094d5b
Jul 23 18:29:49.445074 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.445044    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:29:49.445163 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.445108    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:29:49.445163 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.445137    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:29:49.586159 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.586067    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" event={"ID":"46710f95-1211-403c-b5a5-d769830724c7","Type":"ContainerStarted","Data":"fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d"}
Jul 23 18:29:49.586159 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.586126    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" event={"ID":"46710f95-1211-403c-b5a5-d769830724c7","Type":"ContainerStarted","Data":"c62caaf78bacfc3fb9d7489ffdc47961e313f61ce56a6cbc343a246182094d5b"}
Jul 23 18:29:49.609274 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:49.609226    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" podStartSLOduration=1.6092104090000001 podStartE2EDuration="1.609210409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:29:49.60662306 +0000 UTC m=+1931.439314218" watchObservedRunningTime="2026-07-23 18:29:49.609210409 +0000 UTC m=+1931.441901566"
Jul 23 18:29:50.306087 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:50.306047    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:50.310402 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:50.310380    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:50.591451 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:50.591364    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:29:50.592206 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:29:50.592187    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:30:00.138326 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.136461    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf"]
Jul 23 18:30:00.141868 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.140887    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf"
Jul 23 18:30:00.142468 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.142440    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"]
Jul 23 18:30:00.143717 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.143695    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:30:00.149173 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.149153    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf"]
Jul 23 18:30:00.149389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.149374    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"
Jul 23 18:30:00.151685 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.151659    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"]
Jul 23 18:30:00.167133 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.165421    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf"
Jul 23 18:30:00.175470 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.174378    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"
Jul 23 18:30:00.344264 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.344181    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf"]
Jul 23 18:30:00.388139 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.388074    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"]
Jul 23 18:30:00.390426 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:30:00.390395    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f7f5c5_7df2_412c_96ea_cc9fc897e77f.slice/crio-e45f25f934f1fbfd85a4f56f45eb09168835d9d378434401c7de6322c6fde8b6 WatchSource:0}: Error finding container e45f25f934f1fbfd85a4f56f45eb09168835d9d378434401c7de6322c6fde8b6: Status 404 returned error can't find the container with id e45f25f934f1fbfd85a4f56f45eb09168835d9d378434401c7de6322c6fde8b6
Jul 23 18:30:00.656104 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.655848    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8" event={"ID":"53f7f5c5-7df2-412c-96ea-cc9fc897e77f","Type":"ContainerStarted","Data":"e45f25f934f1fbfd85a4f56f45eb09168835d9d378434401c7de6322c6fde8b6"}
Jul 23 18:30:00.657810 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:00.657683    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf" event={"ID":"ca056b9c-ffd6-4b87-9705-ab1055108966","Type":"ContainerStarted","Data":"7f2bf99dce552928a548ddd64257dc961edc8d1ca9eec19150ed69168a625095"}
Jul 23 18:30:01.666242 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:01.666206    2572 generic.go:356] "Generic (PLEG): container finished" podID="ca056b9c-ffd6-4b87-9705-ab1055108966" containerID="205a477cd086aeafac83e7020cb681b24863e4b5e02cd647b4c235bad2f63294" exitCode=0
Jul 23 18:30:01.666666 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:01.666290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf" event={"ID":"ca056b9c-ffd6-4b87-9705-ab1055108966","Type":"ContainerDied","Data":"205a477cd086aeafac83e7020cb681b24863e4b5e02cd647b4c235bad2f63294"}
Jul 23 18:30:01.667927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:01.667899    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8" event={"ID":"53f7f5c5-7df2-412c-96ea-cc9fc897e77f","Type":"ContainerStarted","Data":"5c7fa67f5793256ac07282388ed0d75b6efdfc55225b2b7fb63ec4339b31d4d9"}
Jul 23 18:30:01.705228 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:01.705100    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8" podStartSLOduration=1.705077409 podStartE2EDuration="1.705077409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:01.703131985 +0000 UTC m=+1943.535823143" watchObservedRunningTime="2026-07-23 18:30:01.705077409 +0000 UTC m=+1943.537768568"
Jul 23 18:30:02.675477 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:02.675446    2572 generic.go:356] "Generic (PLEG): container finished" podID="53f7f5c5-7df2-412c-96ea-cc9fc897e77f" containerID="5c7fa67f5793256ac07282388ed0d75b6efdfc55225b2b7fb63ec4339b31d4d9" exitCode=0
Jul 23 18:30:02.675980 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:02.675536    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8" event={"ID":"53f7f5c5-7df2-412c-96ea-cc9fc897e77f","Type":"ContainerDied","Data":"5c7fa67f5793256ac07282388ed0d75b6efdfc55225b2b7fb63ec4339b31d4d9"}
Jul 23 18:30:02.847951 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:02.847917    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf"
Jul 23 18:30:03.682429 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:03.682396    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf"
Jul 23 18:30:03.682843 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:03.682436    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-bz2lf" event={"ID":"ca056b9c-ffd6-4b87-9705-ab1055108966","Type":"ContainerDied","Data":"7f2bf99dce552928a548ddd64257dc961edc8d1ca9eec19150ed69168a625095"}
Jul 23 18:30:03.682843 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:03.682520    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f2bf99dce552928a548ddd64257dc961edc8d1ca9eec19150ed69168a625095"
Jul 23 18:30:03.831429 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:03.831405    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"
Jul 23 18:30:04.690282 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.690191    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"
Jul 23 18:30:04.690282 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.690226    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8" event={"ID":"53f7f5c5-7df2-412c-96ea-cc9fc897e77f","Type":"ContainerDied","Data":"e45f25f934f1fbfd85a4f56f45eb09168835d9d378434401c7de6322c6fde8b6"}
Jul 23 18:30:04.690846 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.690284    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e45f25f934f1fbfd85a4f56f45eb09168835d9d378434401c7de6322c6fde8b6"
Jul 23 18:30:04.692142 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.692115    2572 generic.go:356] "Generic (PLEG): container finished" podID="46710f95-1211-403c-b5a5-d769830724c7" containerID="fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d" exitCode=0
Jul 23 18:30:04.692260 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.692160    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" event={"ID":"46710f95-1211-403c-b5a5-d769830724c7","Type":"ContainerDied","Data":"fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d"}
Jul 23 18:30:04.692492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.692477    2572 scope.go:117] "RemoveContainer" containerID="fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d"
Jul 23 18:30:04.693599 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.693569    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:30:04.693701 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.693650    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:30:04.693787 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:04.693703    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:30:05.591721 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:05.591685    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:30:05.699337 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:05.699296    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" event={"ID":"46710f95-1211-403c-b5a5-d769830724c7","Type":"ContainerStarted","Data":"f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c"}
Jul 23 18:30:06.306008 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:06.305973    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:30:06.306964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:06.306939    2572 patch_prober.go:28] interesting pod/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 23 18:30:06.307091 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:06.306986    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 23 18:30:07.305890 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:07.305850    2572 patch_prober.go:28] interesting pod/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 23 18:30:07.306373 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:07.305915    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 23 18:30:08.306454 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.306413    2572 patch_prober.go:28] interesting pod/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 23 18:30:08.306985 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.306483    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 23 18:30:08.915710 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.915673    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"]
Jul 23 18:30:08.916240 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.916220    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f7f5c5-7df2-412c-96ea-cc9fc897e77f" containerName="cleanup"
Jul 23 18:30:08.916289 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.916244    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f7f5c5-7df2-412c-96ea-cc9fc897e77f" containerName="cleanup"
Jul 23 18:30:08.916289 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.916262    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca056b9c-ffd6-4b87-9705-ab1055108966" containerName="cleanup"
Jul 23 18:30:08.916289 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.916271    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca056b9c-ffd6-4b87-9705-ab1055108966" containerName="cleanup"
Jul 23 18:30:08.916399 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.916387    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f7f5c5-7df2-412c-96ea-cc9fc897e77f" containerName="cleanup"
Jul 23 18:30:08.916434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.916404    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca056b9c-ffd6-4b87-9705-ab1055108966" containerName="cleanup"
Jul 23 18:30:08.920294 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.920272    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:08.923230 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.923202    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ec1a268e\"/\"default-dockercfg-stfjj\""
Jul 23 18:30:08.923355 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.923236    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ec1a268e\"/\"kube-root-ca.crt\""
Jul 23 18:30:08.924133 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.924116    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ec1a268e\"/\"e2e-lifecycle-model-ec1a268e-kserve-self-signed-certs\""
Jul 23 18:30:08.924251 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.924120    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ec1a268e\"/\"openshift-service-ca.crt\""
Jul 23 18:30:08.941772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:08.936166    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"]
Jul 23 18:30:09.085799 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.085731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7kcg\" (UniqueName: \"kubernetes.io/projected/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-kube-api-access-r7kcg\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.085799 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.085798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tls-certs\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.086038 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.085826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-dshm\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.086038 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.085848    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-model-cache\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.086038 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.086006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tmp-dir\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.086154 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.086037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-home\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.187408 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187309    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7kcg\" (UniqueName: \"kubernetes.io/projected/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-kube-api-access-r7kcg\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.187408 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187349    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tls-certs\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.187408 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-dshm\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.187701 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-model-cache\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.187701 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187624    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tmp-dir\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.187701 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-home\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.187912 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187893    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-model-cache\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.187976 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187956    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-home\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.188010 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.187977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tmp-dir\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.189764 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.189734    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-dshm\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.189957 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.189940    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tls-certs\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.197257 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.197225    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7kcg\" (UniqueName: \"kubernetes.io/projected/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-kube-api-access-r7kcg\") pod \"e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") " pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.252322 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.252286    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:09.306573 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.306373    2572 patch_prober.go:28] interesting pod/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 23 18:30:09.306573 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.306427    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 23 18:30:09.417978 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.417951    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"]
Jul 23 18:30:09.419819 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:30:09.419789    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18bb74f8_c40f_44f9_ac14_e5e2ab1d5f42.slice/crio-5460d719a6d6576f61f78a53442000b34a7aaebee84b926ef742b2bd23aeaa36 WatchSource:0}: Error finding container 5460d719a6d6576f61f78a53442000b34a7aaebee84b926ef742b2bd23aeaa36: Status 404 returned error can't find the container with id 5460d719a6d6576f61f78a53442000b34a7aaebee84b926ef742b2bd23aeaa36
Jul 23 18:30:09.727870 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.727765    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r" event={"ID":"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42","Type":"ContainerStarted","Data":"36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640"}
Jul 23 18:30:09.727870 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.727821    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r" event={"ID":"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42","Type":"ContainerStarted","Data":"5460d719a6d6576f61f78a53442000b34a7aaebee84b926ef742b2bd23aeaa36"}
Jul 23 18:30:09.746930 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:09.746874    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r" podStartSLOduration=1.746857511 podStartE2EDuration="1.746857511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:09.745400835 +0000 UTC m=+1951.578091995" watchObservedRunningTime="2026-07-23 18:30:09.746857511 +0000 UTC m=+1951.579548689"
Jul 23 18:30:10.310077 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:10.310048    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:30:10.310453 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:10.310425    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:30:10.311033 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:10.311013    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:30:19.252690 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:19.252654    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:19.253179 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:19.252707    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:19.266599 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:19.266575    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:19.799803 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:19.799773    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:30:29.701553 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:29.701514    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"]
Jul 23 18:30:29.704990 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:29.704969    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"
Jul 23 18:30:29.707636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:29.707617    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:30:29.707733 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:29.707669    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:30:29.713520 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:29.713498    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"]
Jul 23 18:30:29.764254 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:29.764221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/126664cc-d2c0-4394-8fe5-cb75e2d50f2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w\" (UID: \"126664cc-d2c0-4394-8fe5-cb75e2d50f2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"
Jul 23 18:30:29.864795 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:29.864745    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/126664cc-d2c0-4394-8fe5-cb75e2d50f2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w\" (UID: \"126664cc-d2c0-4394-8fe5-cb75e2d50f2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"
Jul 23 18:30:29.865376 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:29.865355    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/126664cc-d2c0-4394-8fe5-cb75e2d50f2b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w\" (UID: \"126664cc-d2c0-4394-8fe5-cb75e2d50f2b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"
Jul 23 18:30:30.017470 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:30.017444    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"
Jul 23 18:30:30.147054 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:30.147030    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"]
Jul 23 18:30:30.149406 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:30:30.149376    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod126664cc_d2c0_4394_8fe5_cb75e2d50f2b.slice/crio-5912bfc4fb4343ee76af453e5864ce701b5c762682664b28b526189caab2fe45 WatchSource:0}: Error finding container 5912bfc4fb4343ee76af453e5864ce701b5c762682664b28b526189caab2fe45: Status 404 returned error can't find the container with id 5912bfc4fb4343ee76af453e5864ce701b5c762682664b28b526189caab2fe45
Jul 23 18:30:30.847018 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:30.846988    2572 generic.go:356] "Generic (PLEG): container finished" podID="126664cc-d2c0-4394-8fe5-cb75e2d50f2b" containerID="319292cc80f1a6683ec43b1d4427e2d402e8785ab4a2a41f1074c9eedcda7afb" exitCode=0
Jul 23 18:30:30.847342 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:30.847072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w" event={"ID":"126664cc-d2c0-4394-8fe5-cb75e2d50f2b","Type":"ContainerDied","Data":"319292cc80f1a6683ec43b1d4427e2d402e8785ab4a2a41f1074c9eedcda7afb"}
Jul 23 18:30:30.847342 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:30.847151    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w" event={"ID":"126664cc-d2c0-4394-8fe5-cb75e2d50f2b","Type":"ContainerStarted","Data":"5912bfc4fb4343ee76af453e5864ce701b5c762682664b28b526189caab2fe45"}
Jul 23 18:30:31.985358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:31.985335    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"
Jul 23 18:30:32.081987 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:32.081950    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/126664cc-d2c0-4394-8fe5-cb75e2d50f2b-maas-api-service-ca\") pod \"126664cc-d2c0-4394-8fe5-cb75e2d50f2b\" (UID: \"126664cc-d2c0-4394-8fe5-cb75e2d50f2b\") "
Jul 23 18:30:32.082308 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:32.082286    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/126664cc-d2c0-4394-8fe5-cb75e2d50f2b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "126664cc-d2c0-4394-8fe5-cb75e2d50f2b" (UID: "126664cc-d2c0-4394-8fe5-cb75e2d50f2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:30:32.182820 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:32.182715    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/126664cc-d2c0-4394-8fe5-cb75e2d50f2b-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:30:32.861199 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:32.861158    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w" event={"ID":"126664cc-d2c0-4394-8fe5-cb75e2d50f2b","Type":"ContainerDied","Data":"5912bfc4fb4343ee76af453e5864ce701b5c762682664b28b526189caab2fe45"}
Jul 23 18:30:32.861367 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:32.861217    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5912bfc4fb4343ee76af453e5864ce701b5c762682664b28b526189caab2fe45"
Jul 23 18:30:32.861367 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:32.861176    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"
Jul 23 18:30:45.219875 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:45.219838    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"]
Jul 23 18:30:45.221997 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:45.221977    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-ec1a268e-29747190-zd4d8"]
Jul 23 18:30:46.792500 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:46.792467    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53f7f5c5-7df2-412c-96ea-cc9fc897e77f" path="/var/lib/kubelet/pods/53f7f5c5-7df2-412c-96ea-cc9fc897e77f/volumes"
Jul 23 18:30:49.776615 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:49.776579    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"]
Jul 23 18:30:49.778858 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:49.778836    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ec1a268e-8mw9w"]
Jul 23 18:30:50.792850 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:50.792819    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="126664cc-d2c0-4394-8fe5-cb75e2d50f2b" path="/var/lib/kubelet/pods/126664cc-d2c0-4394-8fe5-cb75e2d50f2b/volumes"
Jul 23 18:30:57.139407 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:30:57.139372    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"]
Jul 23 18:31:12.159744 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.159682    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r" podUID="18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" containerName="main" containerID="cri-o://36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640" gracePeriod=45
Jul 23 18:31:12.418057 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.417997    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:31:12.539895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.539856    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tmp-dir\") pod \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") "
Jul 23 18:31:12.539895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.539902    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tls-certs\") pod \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") "
Jul 23 18:31:12.540155 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.539936    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-dshm\") pod \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") "
Jul 23 18:31:12.540155 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.539965    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-home\") pod \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") "
Jul 23 18:31:12.540155 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.540010    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7kcg\" (UniqueName: \"kubernetes.io/projected/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-kube-api-access-r7kcg\") pod \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") "
Jul 23 18:31:12.540155 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.540053    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-model-cache\") pod \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\" (UID: \"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42\") "
Jul 23 18:31:12.540334 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.540151    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" (UID: "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:31:12.540334 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.540262    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-home" (OuterVolumeSpecName: "home") pod "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" (UID: "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:31:12.540449 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.540369    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-model-cache" (OuterVolumeSpecName: "model-cache") pod "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" (UID: "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:31:12.540449 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.540415    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tmp-dir\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:31:12.540449 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.540434    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-home\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:31:12.542310 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.542277    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" (UID: "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:31:12.542391 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.542312    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-dshm" (OuterVolumeSpecName: "dshm") pod "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" (UID: "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:31:12.542391 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.542375    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-kube-api-access-r7kcg" (OuterVolumeSpecName: "kube-api-access-r7kcg") pod "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" (UID: "18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42"). InnerVolumeSpecName "kube-api-access-r7kcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:31:12.640969 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.640926    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7kcg\" (UniqueName: \"kubernetes.io/projected/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-kube-api-access-r7kcg\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:31:12.640969 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.640964    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-model-cache\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:31:12.640969 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.640974    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-tls-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:31:12.640969 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:12.640981    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42-dshm\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:31:13.086852 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.086728    2572 generic.go:356] "Generic (PLEG): container finished" podID="18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" containerID="36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640" exitCode=0
Jul 23 18:31:13.086852 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.086821    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"
Jul 23 18:31:13.087028 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.086816    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r" event={"ID":"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42","Type":"ContainerDied","Data":"36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640"}
Jul 23 18:31:13.087028 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.086931    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r" event={"ID":"18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42","Type":"ContainerDied","Data":"5460d719a6d6576f61f78a53442000b34a7aaebee84b926ef742b2bd23aeaa36"}
Jul 23 18:31:13.087028 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.086947    2572 scope.go:117] "RemoveContainer" containerID="36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640"
Jul 23 18:31:13.096078 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.096063    2572 scope.go:117] "RemoveContainer" containerID="36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640"
Jul 23 18:31:13.096350 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:31:13.096334    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640\": container with ID starting with 36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640 not found: ID does not exist" containerID="36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640"
Jul 23 18:31:13.096402 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.096359    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640"} err="failed to get container status \"36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640\": rpc error: code = NotFound desc = could not find container \"36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640\": container with ID starting with 36a04a84f7ba96bf7979dfe07575b62308aff76eb72f7c5e21d9a8b83e027640 not found: ID does not exist"
Jul 23 18:31:13.104682 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.104658    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"]
Jul 23 18:31:13.108571 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:13.108548    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ec1a268e/e2e-lifecycle-model-ec1a268e-kserve-67995bdd8c-s4m6r"]
Jul 23 18:31:14.792148 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:14.792115    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" path="/var/lib/kubelet/pods/18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42/volumes"
Jul 23 18:31:38.761854 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:38.761818    2572 scope.go:117] "RemoveContainer" containerID="1b609f25e0709ae44e43e762a442d5f095db3b78d357b3ab29fc2cdcca055b37"
Jul 23 18:31:38.770398 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:38.770376    2572 scope.go:117] "RemoveContainer" containerID="88d9a056c12ea3c913765e97e25dd4a5540f6a39d52584aefaa3769db42f0992"
Jul 23 18:31:55.723825 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:55.723787    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"]
Jul 23 18:31:55.724561 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:31:55.724506    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy" containerID="cri-o://f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c" gracePeriod=30
Jul 23 18:32:00.992067 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:00.992006    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:32:01.053915 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.053881    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-certs\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.053915 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.053919    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-envoy\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.054181 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.053965    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-credential-socket\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.054181 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054008    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-data\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.054181 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054041    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-istio-token\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.054181 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054078    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-socket\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.054181 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054102    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46710f95-1211-403c-b5a5-d769830724c7-istio-podinfo\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.054434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054205    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:32:01.054434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054233    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46710f95-1211-403c-b5a5-d769830724c7-istiod-ca-cert\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.054434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054300    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4kcw\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-kube-api-access-f4kcw\") pod \"46710f95-1211-403c-b5a5-d769830724c7\" (UID: \"46710f95-1211-403c-b5a5-d769830724c7\") "
Jul 23 18:32:01.054434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054403    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:32:01.054641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054509    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:32:01.054641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054594    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46710f95-1211-403c-b5a5-d769830724c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:32:01.054781 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054651    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.054781 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054669    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.054781 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.054714    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.055258 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.055237    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:32:01.056483 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.056459    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46710f95-1211-403c-b5a5-d769830724c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:32:01.056577 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.056505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-kube-api-access-f4kcw" (OuterVolumeSpecName: "kube-api-access-f4kcw") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "kube-api-access-f4kcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:32:01.056683 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.056665    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:32:01.056734 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.056664    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "46710f95-1211-403c-b5a5-d769830724c7" (UID: "46710f95-1211-403c-b5a5-d769830724c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:32:01.155330 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.155294    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46710f95-1211-403c-b5a5-d769830724c7-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.155330 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.155326    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46710f95-1211-403c-b5a5-d769830724c7-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.155330 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.155336    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4kcw\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-kube-api-access-f4kcw\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.155330 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.155348    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.155620 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.155361    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46710f95-1211-403c-b5a5-d769830724c7-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.155620 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.155368    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46710f95-1211-403c-b5a5-d769830724c7-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:32:01.350215 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.350183    2572 generic.go:356] "Generic (PLEG): container finished" podID="46710f95-1211-403c-b5a5-d769830724c7" containerID="f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c" exitCode=0
Jul 23 18:32:01.350390 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.350232    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"
Jul 23 18:32:01.350390 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.350265    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" event={"ID":"46710f95-1211-403c-b5a5-d769830724c7","Type":"ContainerDied","Data":"f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c"}
Jul 23 18:32:01.350390 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.350316    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8" event={"ID":"46710f95-1211-403c-b5a5-d769830724c7","Type":"ContainerDied","Data":"c62caaf78bacfc3fb9d7489ffdc47961e313f61ce56a6cbc343a246182094d5b"}
Jul 23 18:32:01.350390 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.350343    2572 scope.go:117] "RemoveContainer" containerID="f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c"
Jul 23 18:32:01.359924 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.359903    2572 scope.go:117] "RemoveContainer" containerID="fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d"
Jul 23 18:32:01.368165 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.368147    2572 scope.go:117] "RemoveContainer" containerID="f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c"
Jul 23 18:32:01.368470 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:32:01.368451    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c\": container with ID starting with f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c not found: ID does not exist" containerID="f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c"
Jul 23 18:32:01.368537 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.368480    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c"} err="failed to get container status \"f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c\": rpc error: code = NotFound desc = could not find container \"f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c\": container with ID starting with f04a0ccb5eb769380f41caad9eb18c6f8af4120797248cf524132e6cd19d087c not found: ID does not exist"
Jul 23 18:32:01.368537 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.368497    2572 scope.go:117] "RemoveContainer" containerID="fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d"
Jul 23 18:32:01.368746 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:32:01.368729    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d\": container with ID starting with fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d not found: ID does not exist" containerID="fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d"
Jul 23 18:32:01.368797 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.368769    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d"} err="failed to get container status \"fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d\": rpc error: code = NotFound desc = could not find container \"fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d\": container with ID starting with fc9cca1bccd1f0096f4631542c8524b10d016bb4776d587f539072d2c883e49d not found: ID does not exist"
Jul 23 18:32:01.375894 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.375871    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"]
Jul 23 18:32:01.382440 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:01.382370    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ec1a268e-openshift-default-5c98d5bd79-nfgf8"]
Jul 23 18:32:02.792598 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:02.792560    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46710f95-1211-403c-b5a5-d769830724c7" path="/var/lib/kubelet/pods/46710f95-1211-403c-b5a5-d769830724c7/volumes"
Jul 23 18:32:38.799567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:38.799536    2572 scope.go:117] "RemoveContainer" containerID="95413fdb97484bda913f04ada0badd562df777cdda918fde62279287c052edd5"
Jul 23 18:32:53.199314 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199278    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"]
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199632    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199642    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199663    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" containerName="main"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199668    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" containerName="main"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199678    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="126664cc-d2c0-4394-8fe5-cb75e2d50f2b" containerName="revoke-keys"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199683    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="126664cc-d2c0-4394-8fe5-cb75e2d50f2b" containerName="revoke-keys"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199736    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="126664cc-d2c0-4394-8fe5-cb75e2d50f2b" containerName="revoke-keys"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199743    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="18bb74f8-c40f-44f9-ac14-e5e2ab1d5f42" containerName="main"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199775    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy"
Jul 23 18:32:53.199794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.199782    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy"
Jul 23 18:32:53.202864 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.202842    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.205690 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.205668    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-954ecd-openshift-default-dockercfg-gmt5s\""
Jul 23 18:32:53.216103 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.216082    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"]
Jul 23 18:32:53.320164 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2901e91c-5a29-49ad-9e1b-10f3a410f839-istiod-ca-cert\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.320164 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-socket\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.320380 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320198    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-certs\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.320380 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-podinfo\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.320380 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-envoy\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.320380 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-token\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.320529 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320383    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-data\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.320529 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320414    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-credential-socket\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.320529 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.320450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm8vw\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-kube-api-access-dm8vw\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.421838 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.421800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-envoy\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.421838 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.421837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-token\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422089 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.421876    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-data\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422089 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.421895    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-credential-socket\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422089 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.421919    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm8vw\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-kube-api-access-dm8vw\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422089 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.421948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2901e91c-5a29-49ad-9e1b-10f3a410f839-istiod-ca-cert\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422089 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.421981    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-socket\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422089 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.422031    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-certs\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422089 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.422056    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-podinfo\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422500 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.422337    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-data\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422500 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.422406    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-certs\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422500 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.422455    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-credential-socket\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422500 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.422473    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-socket\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.422726 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.422702    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2901e91c-5a29-49ad-9e1b-10f3a410f839-istiod-ca-cert\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.424183 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.424163    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-envoy\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.424505 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.424483    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-podinfo\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.431028 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.431000    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-token\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.431379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.431354    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm8vw\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-kube-api-access-dm8vw\") pod \"e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") " pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.513880 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.513852    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:53.659562 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.659534    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"]
Jul 23 18:32:53.660970 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:32:53.660941    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2901e91c_5a29_49ad_9e1b_10f3a410f839.slice/crio-0228c5f89d7bbb81f3df2ca70273b4ba86a7689c11d99c26322e037e82289806 WatchSource:0}: Error finding container 0228c5f89d7bbb81f3df2ca70273b4ba86a7689c11d99c26322e037e82289806: Status 404 returned error can't find the container with id 0228c5f89d7bbb81f3df2ca70273b4ba86a7689c11d99c26322e037e82289806
Jul 23 18:32:53.663028 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.662983    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:53.663119 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.663077    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:53.663165 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:53.663145    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:54.640080 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:54.640042    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" event={"ID":"2901e91c-5a29-49ad-9e1b-10f3a410f839","Type":"ContainerStarted","Data":"a8e58fd4c3197b0b68b5c6063768ef02bbe6405d1edf6d7325cadca06a4e7a60"}
Jul 23 18:32:54.640582 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:54.640106    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" event={"ID":"2901e91c-5a29-49ad-9e1b-10f3a410f839","Type":"ContainerStarted","Data":"0228c5f89d7bbb81f3df2ca70273b4ba86a7689c11d99c26322e037e82289806"}
Jul 23 18:32:54.663646 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:54.663595    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" podStartSLOduration=1.6635796360000001 podStartE2EDuration="1.663579636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:32:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:54.662598883 +0000 UTC m=+2116.495290061" watchObservedRunningTime="2026-07-23 18:32:54.663579636 +0000 UTC m=+2116.496270794"
Jul 23 18:32:55.514202 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:55.514162    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:55.519107 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:55.519083    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:55.646736 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:55.646702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:32:55.647692 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:32:55.647674    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:33:01.883740 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.883700    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"]
Jul 23 18:33:01.884202 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.884129    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy"
Jul 23 18:33:01.884202 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.884143    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="46710f95-1211-403c-b5a5-d769830724c7" containerName="istio-proxy"
Jul 23 18:33:01.887422 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.887402    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.891201 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.891176    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-12054c-openshift-default-dockercfg-6bxbh\""
Jul 23 18:33:01.898149 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-data\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.898272 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898157    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-envoy\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.898272 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898215    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-socket\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.898272 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898237    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-token\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.898272 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898256    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-credential-socket\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.898419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898293    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-certs\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.898419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898320    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-podinfo\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.898419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898381    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879d3bdb-3857-4a9a-9754-7031a4c992aa-istiod-ca-cert\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.898419 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.898405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48zwd\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-kube-api-access-48zwd\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.904528 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.904501    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"]
Jul 23 18:33:01.999458 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-data\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.999644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-envoy\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.999644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999502    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-socket\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.999644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999526    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-token\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.999644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-credential-socket\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.999644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999585    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-certs\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:01.999644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-podinfo\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.000013 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999680    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879d3bdb-3857-4a9a-9754-7031a4c992aa-istiod-ca-cert\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.000013 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999714    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48zwd\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-kube-api-access-48zwd\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.000013 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999873    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-data\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.000013 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:01.999934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-socket\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.000013 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.000001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-certs\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.000185 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.000079    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-credential-socket\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.000503 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.000476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879d3bdb-3857-4a9a-9754-7031a4c992aa-istiod-ca-cert\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.002060 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.002032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-envoy\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.002412 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.002389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-podinfo\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.018341 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.018315    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-token\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.025640 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.025616    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48zwd\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-kube-api-access-48zwd\") pod \"e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") " pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.198775 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.198674    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:02.364278 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.364253    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"]
Jul 23 18:33:02.370947 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.370909    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:02.371047 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.370984    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:02.371047 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.371033    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:02.687688 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.687648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" event={"ID":"879d3bdb-3857-4a9a-9754-7031a4c992aa","Type":"ContainerStarted","Data":"dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258"}
Jul 23 18:33:02.687882 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.687702    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" event={"ID":"879d3bdb-3857-4a9a-9754-7031a4c992aa","Type":"ContainerStarted","Data":"7f7a35ddc955215f2963ff090bff6d9dab605d354ec3b2c96c70fdfb09a7d27d"}
Jul 23 18:33:02.711413 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:02.711359    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" podStartSLOduration=1.711339779 podStartE2EDuration="1.711339779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:33:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:33:02.710793984 +0000 UTC m=+2124.543485138" watchObservedRunningTime="2026-07-23 18:33:02.711339779 +0000 UTC m=+2124.544030939"
Jul 23 18:33:03.199609 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:03.199573    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:03.204576 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:03.204553    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:03.693021 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:03.692994    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:03.694176 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:03.694155    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:10.648774 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:10.648713    2572 patch_prober.go:28] interesting pod/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 23 18:33:10.649317 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:10.648806    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 23 18:33:10.737156 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:10.737112    2572 generic.go:356] "Generic (PLEG): container finished" podID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerID="a8e58fd4c3197b0b68b5c6063768ef02bbe6405d1edf6d7325cadca06a4e7a60" exitCode=0
Jul 23 18:33:10.737356 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:10.737215    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" event={"ID":"2901e91c-5a29-49ad-9e1b-10f3a410f839","Type":"ContainerDied","Data":"a8e58fd4c3197b0b68b5c6063768ef02bbe6405d1edf6d7325cadca06a4e7a60"}
Jul 23 18:33:10.737788 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:10.737742    2572 scope.go:117] "RemoveContainer" containerID="a8e58fd4c3197b0b68b5c6063768ef02bbe6405d1edf6d7325cadca06a4e7a60"
Jul 23 18:33:10.739142 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:10.739096    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:10.739233 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:10.739196    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:10.739294 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:10.739246    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:11.748495 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:11.748454    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" event={"ID":"2901e91c-5a29-49ad-9e1b-10f3a410f839","Type":"ContainerStarted","Data":"15d7add1e57f8f7d7af9f4b6fcc05125faa12bad5ebc52a03ec5f4edb7497e82"}
Jul 23 18:33:12.514509 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:12.514480    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:33:12.514739 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:12.514525    2572 patch_prober.go:28] interesting pod/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 23 18:33:12.514898 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:12.514875    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 23 18:33:13.514240 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:13.514200    2572 patch_prober.go:28] interesting pod/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 23 18:33:13.514614 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:13.514253    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 23 18:33:14.514410 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:14.514373    2572 patch_prober.go:28] interesting pod/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 23 18:33:14.514892 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:14.514433    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 23 18:33:15.514632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:15.514591    2572 patch_prober.go:28] interesting pod/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 23 18:33:15.515069 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:15.514664    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 23 18:33:16.518277 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:16.518247    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:33:16.518794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:16.518630    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:33:16.519337 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:16.519319    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:33:17.788675 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:17.788635    2572 generic.go:356] "Generic (PLEG): container finished" podID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerID="dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258" exitCode=0
Jul 23 18:33:17.789219 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:17.788709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" event={"ID":"879d3bdb-3857-4a9a-9754-7031a4c992aa","Type":"ContainerDied","Data":"dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258"}
Jul 23 18:33:17.789219 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:17.789173    2572 scope.go:117] "RemoveContainer" containerID="dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258"
Jul 23 18:33:17.790218 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:17.790189    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:17.790315 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:17.790271    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:17.790378 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:17.790317    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:33:18.693177 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:18.693135    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:18.798820 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:18.798783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" event={"ID":"879d3bdb-3857-4a9a-9754-7031a4c992aa","Type":"ContainerStarted","Data":"84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7"}
Jul 23 18:33:19.199932 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:19.199893    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:19.200744 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:19.200710    2572 patch_prober.go:28] interesting pod/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 23 18:33:19.200898 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:19.200790    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 23 18:33:20.199322 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:20.199281    2572 patch_prober.go:28] interesting pod/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 23 18:33:20.199718 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:20.199340    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 23 18:33:21.200102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:21.200066    2572 patch_prober.go:28] interesting pod/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 23 18:33:21.200481 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:21.200126    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 23 18:33:22.199490 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:22.199454    2572 patch_prober.go:28] interesting pod/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 23 18:33:22.199679 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:22.199510    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 23 18:33:23.203406 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:23.203375    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:23.203822 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:23.203775    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:23.204376 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:23.204361    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:33:38.826909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:38.826831    2572 scope.go:117] "RemoveContainer" containerID="9a95d37d7b547ac40867def21e3923e47d58e659a774f938ad14f85f99fd0c60"
Jul 23 18:33:41.701866 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.701824    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"]
Jul 23 18:33:41.706765 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.706726    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.709484 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.709463    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-12054c\"/\"kube-root-ca.crt\""
Jul 23 18:33:41.710542 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.710524    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-12054c\"/\"test-model-12054c-kserve-self-signed-certs\""
Jul 23 18:33:41.710642 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.710573    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-12054c\"/\"openshift-service-ca.crt\""
Jul 23 18:33:41.710642 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.710612    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-12054c\"/\"default-dockercfg-62kjp\""
Jul 23 18:33:41.715248 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.715224    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"]
Jul 23 18:33:41.869504 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.869462    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2035319-29fe-4f04-a4f5-9fac56776255-tls-certs\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.869701 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.869517    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfhd6\" (UniqueName: \"kubernetes.io/projected/d2035319-29fe-4f04-a4f5-9fac56776255-kube-api-access-dfhd6\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.869701 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.869619    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-dshm\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.869701 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.869683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-tmp-dir\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.869903 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.869806    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-model-cache\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.869903 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.869836    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-home\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.970492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.970407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-model-cache\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.970492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.970444    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-home\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.970492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.970477    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2035319-29fe-4f04-a4f5-9fac56776255-tls-certs\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.970833 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.970501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfhd6\" (UniqueName: \"kubernetes.io/projected/d2035319-29fe-4f04-a4f5-9fac56776255-kube-api-access-dfhd6\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.970833 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.970530    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-dshm\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.970833 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.970571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-tmp-dir\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.970997 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.970914    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-model-cache\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.971056 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.970987    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-home\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.971056 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.971013    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-tmp-dir\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.972874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.972849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-dshm\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.973549 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.973529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2035319-29fe-4f04-a4f5-9fac56776255-tls-certs\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:41.979100 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:41.979081    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfhd6\" (UniqueName: \"kubernetes.io/projected/d2035319-29fe-4f04-a4f5-9fac56776255-kube-api-access-dfhd6\") pod \"test-model-12054c-kserve-6f676bc755-xx5gq\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") " pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:42.017070 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:42.017046    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:42.157538 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:42.157509    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"]
Jul 23 18:33:42.158879 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:33:42.158849    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2035319_29fe_4f04_a4f5_9fac56776255.slice/crio-808cce2929e99aaafc4fadabbed0f4d60cdcb3db0541434568d213706fab1ab3 WatchSource:0}: Error finding container 808cce2929e99aaafc4fadabbed0f4d60cdcb3db0541434568d213706fab1ab3: Status 404 returned error can't find the container with id 808cce2929e99aaafc4fadabbed0f4d60cdcb3db0541434568d213706fab1ab3
Jul 23 18:33:42.932538 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:42.932497    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq" event={"ID":"d2035319-29fe-4f04-a4f5-9fac56776255","Type":"ContainerStarted","Data":"eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a"}
Jul 23 18:33:42.933045 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:42.932549    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq" event={"ID":"d2035319-29fe-4f04-a4f5-9fac56776255","Type":"ContainerStarted","Data":"808cce2929e99aaafc4fadabbed0f4d60cdcb3db0541434568d213706fab1ab3"}
Jul 23 18:33:42.953231 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:42.953182    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq" podStartSLOduration=1.9531677570000001 podStartE2EDuration="1.953167757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:33:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:33:42.949800099 +0000 UTC m=+2164.782491259" watchObservedRunningTime="2026-07-23 18:33:42.953167757 +0000 UTC m=+2164.785858914"
Jul 23 18:33:52.018075 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:52.018044    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:52.018455 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:52.018105    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:52.032112 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:52.032089    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:33:52.997870 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:33:52.997837    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:34:24.880592 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:24.880556    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"]
Jul 23 18:34:25.021680 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.021640    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"]
Jul 23 18:34:25.025366 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.025343    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"
Jul 23 18:34:25.028006 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.027983    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:34:25.028156 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.028128    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:34:25.034625 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.034247    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"]
Jul 23 18:34:25.151069 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.150991    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ce664-b360-47c7-bfad-7f81d4747702-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p\" (UID: \"5d9ce664-b360-47c7-bfad-7f81d4747702\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"
Jul 23 18:34:25.251582 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.251543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ce664-b360-47c7-bfad-7f81d4747702-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p\" (UID: \"5d9ce664-b360-47c7-bfad-7f81d4747702\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"
Jul 23 18:34:25.252243 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.252220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ce664-b360-47c7-bfad-7f81d4747702-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p\" (UID: \"5d9ce664-b360-47c7-bfad-7f81d4747702\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"
Jul 23 18:34:25.339546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.339510    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"
Jul 23 18:34:25.483147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:25.483042    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"]
Jul 23 18:34:25.485486 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:34:25.485458    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9ce664_b360_47c7_bfad_7f81d4747702.slice/crio-54d35d45e3f8074e305a1e4ba8640a48137ad561fcc1c4aad1241762c20c52c7 WatchSource:0}: Error finding container 54d35d45e3f8074e305a1e4ba8640a48137ad561fcc1c4aad1241762c20c52c7: Status 404 returned error can't find the container with id 54d35d45e3f8074e305a1e4ba8640a48137ad561fcc1c4aad1241762c20c52c7
Jul 23 18:34:26.165004 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:26.164975    2572 generic.go:356] "Generic (PLEG): container finished" podID="5d9ce664-b360-47c7-bfad-7f81d4747702" containerID="9147e38c74c10c5c621abdd496a2bb677b58dd0287e0e0dcb993cfa0fc6299df" exitCode=0
Jul 23 18:34:26.165334 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:26.165062    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p" event={"ID":"5d9ce664-b360-47c7-bfad-7f81d4747702","Type":"ContainerDied","Data":"9147e38c74c10c5c621abdd496a2bb677b58dd0287e0e0dcb993cfa0fc6299df"}
Jul 23 18:34:26.165334 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:26.165112    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p" event={"ID":"5d9ce664-b360-47c7-bfad-7f81d4747702","Type":"ContainerStarted","Data":"54d35d45e3f8074e305a1e4ba8640a48137ad561fcc1c4aad1241762c20c52c7"}
Jul 23 18:34:27.301129 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:27.301106    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"
Jul 23 18:34:27.479727 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:27.479636    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ce664-b360-47c7-bfad-7f81d4747702-maas-api-service-ca\") pod \"5d9ce664-b360-47c7-bfad-7f81d4747702\" (UID: \"5d9ce664-b360-47c7-bfad-7f81d4747702\") "
Jul 23 18:34:27.479993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:27.479971    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d9ce664-b360-47c7-bfad-7f81d4747702-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d9ce664-b360-47c7-bfad-7f81d4747702" (UID: "5d9ce664-b360-47c7-bfad-7f81d4747702"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:34:27.580526 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:27.580496    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ce664-b360-47c7-bfad-7f81d4747702-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:28.177137 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:28.177104    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p" event={"ID":"5d9ce664-b360-47c7-bfad-7f81d4747702","Type":"ContainerDied","Data":"54d35d45e3f8074e305a1e4ba8640a48137ad561fcc1c4aad1241762c20c52c7"}
Jul 23 18:34:28.177137 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:28.177139    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"
Jul 23 18:34:28.177341 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:28.177152    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54d35d45e3f8074e305a1e4ba8640a48137ad561fcc1c4aad1241762c20c52c7"
Jul 23 18:34:39.900772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:39.900705    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq" podUID="d2035319-29fe-4f04-a4f5-9fac56776255" containerName="main" containerID="cri-o://eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a" gracePeriod=45
Jul 23 18:34:40.156669 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.156614    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:34:40.181998 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.181969    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"]
Jul 23 18:34:40.196334 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196312    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-home\") pod \"d2035319-29fe-4f04-a4f5-9fac56776255\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") "
Jul 23 18:34:40.196417 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196350    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2035319-29fe-4f04-a4f5-9fac56776255-tls-certs\") pod \"d2035319-29fe-4f04-a4f5-9fac56776255\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") "
Jul 23 18:34:40.196417 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196391    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-tmp-dir\") pod \"d2035319-29fe-4f04-a4f5-9fac56776255\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") "
Jul 23 18:34:40.196486 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196415    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-model-cache\") pod \"d2035319-29fe-4f04-a4f5-9fac56776255\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") "
Jul 23 18:34:40.196486 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196452    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-dshm\") pod \"d2035319-29fe-4f04-a4f5-9fac56776255\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") "
Jul 23 18:34:40.196567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196487    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfhd6\" (UniqueName: \"kubernetes.io/projected/d2035319-29fe-4f04-a4f5-9fac56776255-kube-api-access-dfhd6\") pod \"d2035319-29fe-4f04-a4f5-9fac56776255\" (UID: \"d2035319-29fe-4f04-a4f5-9fac56776255\") "
Jul 23 18:34:40.196623 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196588    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-home" (OuterVolumeSpecName: "home") pod "d2035319-29fe-4f04-a4f5-9fac56776255" (UID: "d2035319-29fe-4f04-a4f5-9fac56776255"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:40.196704 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196677    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2035319-29fe-4f04-a4f5-9fac56776255" (UID: "d2035319-29fe-4f04-a4f5-9fac56776255"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:40.196786 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196693    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2035319-29fe-4f04-a4f5-9fac56776255" (UID: "d2035319-29fe-4f04-a4f5-9fac56776255"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:40.196923 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196894    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-home\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:40.196981 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196951    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-tmp-dir\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:40.196981 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.196967    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-model-cache\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:40.199180 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.199151    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2035319-29fe-4f04-a4f5-9fac56776255-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2035319-29fe-4f04-a4f5-9fac56776255" (UID: "d2035319-29fe-4f04-a4f5-9fac56776255"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:34:40.199435 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.199406    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-dshm" (OuterVolumeSpecName: "dshm") pod "d2035319-29fe-4f04-a4f5-9fac56776255" (UID: "d2035319-29fe-4f04-a4f5-9fac56776255"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:40.199557 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.199450    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2035319-29fe-4f04-a4f5-9fac56776255-kube-api-access-dfhd6" (OuterVolumeSpecName: "kube-api-access-dfhd6") pod "d2035319-29fe-4f04-a4f5-9fac56776255" (UID: "d2035319-29fe-4f04-a4f5-9fac56776255"). InnerVolumeSpecName "kube-api-access-dfhd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:34:40.203862 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.203841    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-954ecd-kwq2p"]
Jul 23 18:34:40.252411 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.252384    2572 generic.go:356] "Generic (PLEG): container finished" podID="d2035319-29fe-4f04-a4f5-9fac56776255" containerID="eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a" exitCode=0
Jul 23 18:34:40.252525 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.252428    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"
Jul 23 18:34:40.252525 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.252471    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq" event={"ID":"d2035319-29fe-4f04-a4f5-9fac56776255","Type":"ContainerDied","Data":"eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a"}
Jul 23 18:34:40.252525 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.252518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq" event={"ID":"d2035319-29fe-4f04-a4f5-9fac56776255","Type":"ContainerDied","Data":"808cce2929e99aaafc4fadabbed0f4d60cdcb3db0541434568d213706fab1ab3"}
Jul 23 18:34:40.252633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.252539    2572 scope.go:117] "RemoveContainer" containerID="eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a"
Jul 23 18:34:40.262942 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.262867    2572 scope.go:117] "RemoveContainer" containerID="eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a"
Jul 23 18:34:40.263250 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:34:40.263190    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a\": container with ID starting with eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a not found: ID does not exist" containerID="eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a"
Jul 23 18:34:40.263250 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.263221    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a"} err="failed to get container status \"eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a\": rpc error: code = NotFound desc = could not find container \"eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a\": container with ID starting with eb8b82d9c014cdcccca061197238a4b1adc8aa875fdefc7445b10b8596ca055a not found: ID does not exist"
Jul 23 18:34:40.294551 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.294531    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"]
Jul 23 18:34:40.297512 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.297481    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2035319-29fe-4f04-a4f5-9fac56776255-dshm\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:40.297512 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.297513    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfhd6\" (UniqueName: \"kubernetes.io/projected/d2035319-29fe-4f04-a4f5-9fac56776255-kube-api-access-dfhd6\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:40.297638 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.297524    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2035319-29fe-4f04-a4f5-9fac56776255-tls-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:40.302964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.302946    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-12054c/test-model-12054c-kserve-6f676bc755-xx5gq"]
Jul 23 18:34:40.793447 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.793414    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d9ce664-b360-47c7-bfad-7f81d4747702" path="/var/lib/kubelet/pods/5d9ce664-b360-47c7-bfad-7f81d4747702/volumes"
Jul 23 18:34:40.793833 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:40.793819    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2035319-29fe-4f04-a4f5-9fac56776255" path="/var/lib/kubelet/pods/d2035319-29fe-4f04-a4f5-9fac56776255/volumes"
Jul 23 18:34:47.127866 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.127834    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"]
Jul 23 18:34:47.128331 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.128074    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy" containerID="cri-o://15d7add1e57f8f7d7af9f4b6fcc05125faa12bad5ebc52a03ec5f4edb7497e82" gracePeriod=30
Jul 23 18:34:47.528108 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.528075    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"]
Jul 23 18:34:47.528446 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.528434    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2035319-29fe-4f04-a4f5-9fac56776255" containerName="main"
Jul 23 18:34:47.528513 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.528448    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2035319-29fe-4f04-a4f5-9fac56776255" containerName="main"
Jul 23 18:34:47.528513 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.528457    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9ce664-b360-47c7-bfad-7f81d4747702" containerName="revoke-keys"
Jul 23 18:34:47.528513 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.528463    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9ce664-b360-47c7-bfad-7f81d4747702" containerName="revoke-keys"
Jul 23 18:34:47.528608 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.528520    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d9ce664-b360-47c7-bfad-7f81d4747702" containerName="revoke-keys"
Jul 23 18:34:47.528608 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.528527    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2035319-29fe-4f04-a4f5-9fac56776255" containerName="main"
Jul 23 18:34:47.531611 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.531591    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"
Jul 23 18:34:47.534788 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.534766    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:34:47.534882 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.534766    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:34:47.544944 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.544922    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"]
Jul 23 18:34:47.658822 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.658794    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a991e-a258-4453-8cc4-314cc0441f14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz\" (UID: \"9a7a991e-a258-4453-8cc4-314cc0441f14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"
Jul 23 18:34:47.759393 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.759364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a991e-a258-4453-8cc4-314cc0441f14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz\" (UID: \"9a7a991e-a258-4453-8cc4-314cc0441f14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"
Jul 23 18:34:47.759994 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.759975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a991e-a258-4453-8cc4-314cc0441f14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz\" (UID: \"9a7a991e-a258-4453-8cc4-314cc0441f14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"
Jul 23 18:34:47.842143 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.842065    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"
Jul 23 18:34:47.973152 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:47.973128    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"]
Jul 23 18:34:47.975092 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:34:47.975070    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7a991e_a258_4453_8cc4_314cc0441f14.slice/crio-71c36e71193b0cbe14b545604fdcceddd1fa29f4c9fbd91b6c848f833d1b76e1 WatchSource:0}: Error finding container 71c36e71193b0cbe14b545604fdcceddd1fa29f4c9fbd91b6c848f833d1b76e1: Status 404 returned error can't find the container with id 71c36e71193b0cbe14b545604fdcceddd1fa29f4c9fbd91b6c848f833d1b76e1
Jul 23 18:34:48.298094 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:48.298058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz" event={"ID":"9a7a991e-a258-4453-8cc4-314cc0441f14","Type":"ContainerStarted","Data":"08d6dfa40a3224fb68cf0d7ce9a42d712660731ae2bc96d2352663f9c051456c"}
Jul 23 18:34:48.298449 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:48.298114    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz" event={"ID":"9a7a991e-a258-4453-8cc4-314cc0441f14","Type":"ContainerStarted","Data":"71c36e71193b0cbe14b545604fdcceddd1fa29f4c9fbd91b6c848f833d1b76e1"}
Jul 23 18:34:48.316943 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:48.316894    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz" podStartSLOduration=1.316881025 podStartE2EDuration="1.316881025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:34:48.314371543 +0000 UTC m=+2230.147062739" watchObservedRunningTime="2026-07-23 18:34:48.316881025 +0000 UTC m=+2230.149572183"
Jul 23 18:34:49.304837 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:49.304802    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a7a991e-a258-4453-8cc4-314cc0441f14" containerID="08d6dfa40a3224fb68cf0d7ce9a42d712660731ae2bc96d2352663f9c051456c" exitCode=0
Jul 23 18:34:49.305237 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:49.304881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz" event={"ID":"9a7a991e-a258-4453-8cc4-314cc0441f14","Type":"ContainerDied","Data":"08d6dfa40a3224fb68cf0d7ce9a42d712660731ae2bc96d2352663f9c051456c"}
Jul 23 18:34:50.445382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:50.445358    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"
Jul 23 18:34:50.484805 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:50.484769    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a991e-a258-4453-8cc4-314cc0441f14-maas-api-service-ca\") pod \"9a7a991e-a258-4453-8cc4-314cc0441f14\" (UID: \"9a7a991e-a258-4453-8cc4-314cc0441f14\") "
Jul 23 18:34:50.485121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:50.485097    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a7a991e-a258-4453-8cc4-314cc0441f14-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9a7a991e-a258-4453-8cc4-314cc0441f14" (UID: "9a7a991e-a258-4453-8cc4-314cc0441f14"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:34:50.586179 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:50.586113    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7a991e-a258-4453-8cc4-314cc0441f14-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:51.316377 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:51.316343    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"
Jul 23 18:34:51.316554 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:51.316377    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz" event={"ID":"9a7a991e-a258-4453-8cc4-314cc0441f14","Type":"ContainerDied","Data":"71c36e71193b0cbe14b545604fdcceddd1fa29f4c9fbd91b6c848f833d1b76e1"}
Jul 23 18:34:51.316554 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:51.316422    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71c36e71193b0cbe14b545604fdcceddd1fa29f4c9fbd91b6c848f833d1b76e1"
Jul 23 18:34:52.326589 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.326560    2572 generic.go:356] "Generic (PLEG): container finished" podID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerID="15d7add1e57f8f7d7af9f4b6fcc05125faa12bad5ebc52a03ec5f4edb7497e82" exitCode=0
Jul 23 18:34:52.327045 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.326596    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" event={"ID":"2901e91c-5a29-49ad-9e1b-10f3a410f839","Type":"ContainerDied","Data":"15d7add1e57f8f7d7af9f4b6fcc05125faa12bad5ebc52a03ec5f4edb7497e82"}
Jul 23 18:34:52.327045 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.326643    2572 scope.go:117] "RemoveContainer" containerID="a8e58fd4c3197b0b68b5c6063768ef02bbe6405d1edf6d7325cadca06a4e7a60"
Jul 23 18:34:52.381037 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.381012    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:34:52.502552 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502449    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-envoy\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.502552 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502529    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-podinfo\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.502552 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502549    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-data\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.502852 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502584    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm8vw\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-kube-api-access-dm8vw\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.502852 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502614    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-credential-socket\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.502852 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502638    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2901e91c-5a29-49ad-9e1b-10f3a410f839-istiod-ca-cert\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.502852 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502682    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-certs\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.502852 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502737    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-token\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.502852 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.502790    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-socket\") pod \"2901e91c-5a29-49ad-9e1b-10f3a410f839\" (UID: \"2901e91c-5a29-49ad-9e1b-10f3a410f839\") "
Jul 23 18:34:52.503093 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.503070    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:52.503367 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.503339    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:52.503460 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.503369    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2901e91c-5a29-49ad-9e1b-10f3a410f839-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:34:52.503543 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.503522    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:52.503639 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.503611    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-data" (OuterVolumeSpecName: "istio-data") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:52.504926 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.504895    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:34:52.504926 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.504904    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:34:52.505175 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.505156    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-kube-api-access-dm8vw" (OuterVolumeSpecName: "kube-api-access-dm8vw") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "kube-api-access-dm8vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:34:52.505279 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.505258    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-token" (OuterVolumeSpecName: "istio-token") pod "2901e91c-5a29-49ad-9e1b-10f3a410f839" (UID: "2901e91c-5a29-49ad-9e1b-10f3a410f839"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:34:52.603992 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.603959    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:52.603992 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.603988    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:52.603992 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.603998    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm8vw\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-kube-api-access-dm8vw\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:52.604232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.604009    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:52.604232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.604018    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2901e91c-5a29-49ad-9e1b-10f3a410f839-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:52.604232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.604027    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:52.604232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.604034    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:52.604232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.604041    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:52.604232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:52.604048    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2901e91c-5a29-49ad-9e1b-10f3a410f839-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:34:53.333656 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:53.333628    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"
Jul 23 18:34:53.334152 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:53.333674    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5" event={"ID":"2901e91c-5a29-49ad-9e1b-10f3a410f839","Type":"ContainerDied","Data":"0228c5f89d7bbb81f3df2ca70273b4ba86a7689c11d99c26322e037e82289806"}
Jul 23 18:34:53.334152 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:53.333730    2572 scope.go:117] "RemoveContainer" containerID="15d7add1e57f8f7d7af9f4b6fcc05125faa12bad5ebc52a03ec5f4edb7497e82"
Jul 23 18:34:53.355630 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:53.355606    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"]
Jul 23 18:34:53.360532 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:53.360509    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-954ecd-openshift-default-6795cdbd57-zmqg5"]
Jul 23 18:34:54.793216 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:34:54.793182    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" path="/var/lib/kubelet/pods/2901e91c-5a29-49ad-9e1b-10f3a410f839/volumes"
Jul 23 18:35:02.626261 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:02.626162    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"]
Jul 23 18:35:02.628441 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:02.628413    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-12054c-nqfhz"]
Jul 23 18:35:02.792366 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:02.792333    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a7a991e-a258-4453-8cc4-314cc0441f14" path="/var/lib/kubelet/pods/9a7a991e-a258-4453-8cc4-314cc0441f14/volumes"
Jul 23 18:35:09.900386 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:09.900351    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"]
Jul 23 18:35:09.900805 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:09.900552    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy" containerID="cri-o://84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7" gracePeriod=30
Jul 23 18:35:10.858170 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858138    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"]
Jul 23 18:35:10.858520 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858507    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy"
Jul 23 18:35:10.858567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858522    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy"
Jul 23 18:35:10.858567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858538    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy"
Jul 23 18:35:10.858567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858543    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy"
Jul 23 18:35:10.858567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858556    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a7a991e-a258-4453-8cc4-314cc0441f14" containerName="revoke-keys"
Jul 23 18:35:10.858567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858565    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a7a991e-a258-4453-8cc4-314cc0441f14" containerName="revoke-keys"
Jul 23 18:35:10.858729 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858633    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy"
Jul 23 18:35:10.858729 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.858648    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a7a991e-a258-4453-8cc4-314cc0441f14" containerName="revoke-keys"
Jul 23 18:35:10.862814 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.862788    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.868346 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.868325    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-debfbc-openshift-default-dockercfg-9dlfr\""
Jul 23 18:35:10.878860 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.878833    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"]
Jul 23 18:35:10.970960 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.970925    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbnx\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-kube-api-access-wtbnx\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.971379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.970976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-certs\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.971379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.971055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-envoy\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.971379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.971114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-data\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.971379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.971145    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istiod-ca-cert\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.971379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.971190    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-socket\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.971379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.971209    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-credential-socket\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.971379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.971231    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-podinfo\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:10.971379 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:10.971284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-token\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.072681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.072644    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-socket\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.072681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.072687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-credential-socket\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.072993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.072708    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-podinfo\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.072993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.072770    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-token\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.072993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.072796    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbnx\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-kube-api-access-wtbnx\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.072993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.072844    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-certs\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.072993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.072918    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-envoy\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.072993 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.072952    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-data\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.073282 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.073121    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istiod-ca-cert\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.073282 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.073169    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-credential-socket\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.073282 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.073123    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-socket\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.073282 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.073268    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-certs\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.073426 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.073289    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-data\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.073691 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.073672    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istiod-ca-cert\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.075223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.075202    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-envoy\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.075309 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.075240    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-podinfo\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.082706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.082686    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbnx\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-kube-api-access-wtbnx\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.083857 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.083838    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-token\") pod \"e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") " pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.172706 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.172618    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:11.319009 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.318981    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"]
Jul 23 18:35:11.320120 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:35:11.320094    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e007f88_5166_4beb_9cd3_41f68b5ec9f9.slice/crio-d7979fdfa0fbeecefe9ae6e227b1c0a2f4a2908c091fcb0862f11dcbd66c488b WatchSource:0}: Error finding container d7979fdfa0fbeecefe9ae6e227b1c0a2f4a2908c091fcb0862f11dcbd66c488b: Status 404 returned error can't find the container with id d7979fdfa0fbeecefe9ae6e227b1c0a2f4a2908c091fcb0862f11dcbd66c488b
Jul 23 18:35:11.322365 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.322332    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:11.322441 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.322396    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:11.322480 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.322442    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:11.434657 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.434563    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" event={"ID":"2e007f88-5166-4beb-9cd3-41f68b5ec9f9","Type":"ContainerStarted","Data":"9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474"}
Jul 23 18:35:11.434657 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.434623    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" event={"ID":"2e007f88-5166-4beb-9cd3-41f68b5ec9f9","Type":"ContainerStarted","Data":"d7979fdfa0fbeecefe9ae6e227b1c0a2f4a2908c091fcb0862f11dcbd66c488b"}
Jul 23 18:35:11.459392 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:11.459321    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" podStartSLOduration=1.4592999 podStartE2EDuration="1.4592999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:11.456937159 +0000 UTC m=+2253.289628321" watchObservedRunningTime="2026-07-23 18:35:11.4592999 +0000 UTC m=+2253.291991059"
Jul 23 18:35:12.173431 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:12.173391    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:12.178302 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:12.178276    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:12.447646 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:12.447550    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:12.448453 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:12.448431    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:15.160058 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.160004    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:35:15.315117 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315083    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-token\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315308 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315129    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-envoy\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315308 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315179    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-data\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315308 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315284    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-credential-socket\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315318    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-certs\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315346    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-socket\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315370    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879d3bdb-3857-4a9a-9754-7031a4c992aa-istiod-ca-cert\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315416    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-podinfo\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315474 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315446    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48zwd\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-kube-api-access-48zwd\") pod \"879d3bdb-3857-4a9a-9754-7031a4c992aa\" (UID: \"879d3bdb-3857-4a9a-9754-7031a4c992aa\") "
Jul 23 18:35:15.315700 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315546    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:35:15.315773 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315734    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:35:15.315773 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315729    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:35:15.315931 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.315900    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.316078 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.316058    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/879d3bdb-3857-4a9a-9754-7031a4c992aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:35:15.316368 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.316350    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:35:15.317605 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.317579    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:35:15.317734 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.317714    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:35:15.317939 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.317921    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:35:15.317989 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.317954    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-kube-api-access-48zwd" (OuterVolumeSpecName: "kube-api-access-48zwd") pod "879d3bdb-3857-4a9a-9754-7031a4c992aa" (UID: "879d3bdb-3857-4a9a-9754-7031a4c992aa"). InnerVolumeSpecName "kube-api-access-48zwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:35:15.416972 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.416866    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.416972 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.416897    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.416972 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.416922    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.416972 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.416933    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/879d3bdb-3857-4a9a-9754-7031a4c992aa-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.416972 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.416944    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.416972 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.416957    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48zwd\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-kube-api-access-48zwd\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.416972 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.416971    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.417297 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.416982    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/879d3bdb-3857-4a9a-9754-7031a4c992aa-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:15.465567 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.465535    2572 generic.go:356] "Generic (PLEG): container finished" podID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerID="84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7" exitCode=0
Jul 23 18:35:15.465772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.465584    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"
Jul 23 18:35:15.465772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.465628    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" event={"ID":"879d3bdb-3857-4a9a-9754-7031a4c992aa","Type":"ContainerDied","Data":"84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7"}
Jul 23 18:35:15.465772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.465680    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b" event={"ID":"879d3bdb-3857-4a9a-9754-7031a4c992aa","Type":"ContainerDied","Data":"7f7a35ddc955215f2963ff090bff6d9dab605d354ec3b2c96c70fdfb09a7d27d"}
Jul 23 18:35:15.465772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.465701    2572 scope.go:117] "RemoveContainer" containerID="84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7"
Jul 23 18:35:15.475511 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.475494    2572 scope.go:117] "RemoveContainer" containerID="dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258"
Jul 23 18:35:15.483308 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.483292    2572 scope.go:117] "RemoveContainer" containerID="84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7"
Jul 23 18:35:15.483560 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:35:15.483540    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7\": container with ID starting with 84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7 not found: ID does not exist" containerID="84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7"
Jul 23 18:35:15.483605 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.483568    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7"} err="failed to get container status \"84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7\": rpc error: code = NotFound desc = could not find container \"84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7\": container with ID starting with 84061542bec1868ec907596b038346b4218c7d4e3091518271a7e712c79fa0a7 not found: ID does not exist"
Jul 23 18:35:15.483605 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.483587    2572 scope.go:117] "RemoveContainer" containerID="dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258"
Jul 23 18:35:15.483830 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:35:15.483806    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258\": container with ID starting with dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258 not found: ID does not exist" containerID="dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258"
Jul 23 18:35:15.483915 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.483829    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258"} err="failed to get container status \"dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258\": rpc error: code = NotFound desc = could not find container \"dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258\": container with ID starting with dfd3c775cfa3cedbb0739335dc4baae9e06d02fd06b316a619d8a88738d8a258 not found: ID does not exist"
Jul 23 18:35:15.489331 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.489311    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"]
Jul 23 18:35:15.495026 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:15.495006    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-12054c-openshift-default-67844b8769-7ds2b"]
Jul 23 18:35:16.792575 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:16.792542    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" path="/var/lib/kubelet/pods/879d3bdb-3857-4a9a-9754-7031a4c992aa/volumes"
Jul 23 18:35:18.802150 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.802117    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"]
Jul 23 18:35:18.802519 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.802494    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy"
Jul 23 18:35:18.802519 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.802506    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy"
Jul 23 18:35:18.802519 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.802519    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy"
Jul 23 18:35:18.802636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.802524    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy"
Jul 23 18:35:18.802636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.802578    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2901e91c-5a29-49ad-9e1b-10f3a410f839" containerName="istio-proxy"
Jul 23 18:35:18.802636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.802586    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy"
Jul 23 18:35:18.802636 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.802592    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="879d3bdb-3857-4a9a-9754-7031a4c992aa" containerName="istio-proxy"
Jul 23 18:35:18.807149 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.807128    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.809850 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.809833    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0bce45-openshift-default-dockercfg-5b7ft\""
Jul 23 18:35:18.818939 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.818915    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"]
Jul 23 18:35:18.949420 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-data\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.949420 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-podinfo\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.949632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-token\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.949632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istiod-ca-cert\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.949632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949568    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-envoy\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.949632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qqzb\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-kube-api-access-2qqzb\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.949632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949623    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-socket\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.949878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-certs\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:18.949878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:18.949742    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-credential-socket\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.050544 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-data\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.050544 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-podinfo\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.050809 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-token\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.050809 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050616    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istiod-ca-cert\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.050809 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050697    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-envoy\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.050809 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050714    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qqzb\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-kube-api-access-2qqzb\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.050809 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-socket\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.051070 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050814    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-certs\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.051070 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.050841    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-credential-socket\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.051070 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.051001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-data\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.051235 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.051172    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-credential-socket\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.051292 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.051263    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-certs\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.051382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.051356    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-socket\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.051566 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.051548    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istiod-ca-cert\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.052896 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.052855    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-envoy\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.053424 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.053406    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-podinfo\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.060995 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.060973    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-token\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.061243 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.061206    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qqzb\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-kube-api-access-2qqzb\") pod \"e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") " pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.117070 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.117037    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:19.300360 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.300327    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"]
Jul 23 18:35:19.300858 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:35:19.300829    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4e702d_c6b6_41d2_84c9_086264a3d15f.slice/crio-3c875cfd89da2913b5cfdc748d6e17fbb4095a0525bd9bfad964635c93977f31 WatchSource:0}: Error finding container 3c875cfd89da2913b5cfdc748d6e17fbb4095a0525bd9bfad964635c93977f31: Status 404 returned error can't find the container with id 3c875cfd89da2913b5cfdc748d6e17fbb4095a0525bd9bfad964635c93977f31
Jul 23 18:35:19.303200 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.303116    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:19.303299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.303199    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:19.303299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.303238    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:19.492016 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.491970    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" event={"ID":"3e4e702d-c6b6-41d2-84c9-086264a3d15f","Type":"ContainerStarted","Data":"e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873"}
Jul 23 18:35:19.492190 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.492041    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" event={"ID":"3e4e702d-c6b6-41d2-84c9-086264a3d15f","Type":"ContainerStarted","Data":"3c875cfd89da2913b5cfdc748d6e17fbb4095a0525bd9bfad964635c93977f31"}
Jul 23 18:35:19.517000 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:19.516941    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" podStartSLOduration=1.516918298 podStartE2EDuration="1.516918298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:19.514801108 +0000 UTC m=+2261.347492292" watchObservedRunningTime="2026-07-23 18:35:19.516918298 +0000 UTC m=+2261.349609435"
Jul 23 18:35:20.118053 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:20.118009    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:20.123285 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:20.123257    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:20.497720 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:20.497634    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:20.498484 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:20.498463    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:28.489917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:28.489873    2572 patch_prober.go:28] interesting pod/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 18:35:28.490314 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:28.489944    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 18:35:29.551988 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:29.551955    2572 generic.go:356] "Generic (PLEG): container finished" podID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerID="9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474" exitCode=0
Jul 23 18:35:29.552365 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:29.552031    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" event={"ID":"2e007f88-5166-4beb-9cd3-41f68b5ec9f9","Type":"ContainerDied","Data":"9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474"}
Jul 23 18:35:29.552459 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:29.552443    2572 scope.go:117] "RemoveContainer" containerID="9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474"
Jul 23 18:35:29.553432 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:29.553405    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:29.553491 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:29.553477    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:29.553533 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:29.553521    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:30.561040 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:30.561008    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" event={"ID":"2e007f88-5166-4beb-9cd3-41f68b5ec9f9","Type":"ContainerStarted","Data":"fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80"}
Jul 23 18:35:31.172895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:31.172855    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:31.173148 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:31.173121    2572 patch_prober.go:28] interesting pod/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Jul 23 18:35:31.173221 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:31.173202    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Jul 23 18:35:32.173531 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:32.173492    2572 patch_prober.go:28] interesting pod/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Jul 23 18:35:32.174577 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:32.174155    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Jul 23 18:35:33.173166 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:33.173123    2572 patch_prober.go:28] interesting pod/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Jul 23 18:35:33.173417 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:33.173192    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Jul 23 18:35:34.174123 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.174079    2572 patch_prober.go:28] interesting pod/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Jul 23 18:35:34.175152 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.174706    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Jul 23 18:35:34.270886 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.270851    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"]
Jul 23 18:35:34.276438 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.276412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"
Jul 23 18:35:34.279897 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.279873    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:35:34.280272 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.280256    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:35:34.285098 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.285057    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"]
Jul 23 18:35:34.394579 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.394542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1692a0-5357-4d3d-8264-144c54fc9d14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q\" (UID: \"8b1692a0-5357-4d3d-8264-144c54fc9d14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"
Jul 23 18:35:34.495742 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.495645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1692a0-5357-4d3d-8264-144c54fc9d14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q\" (UID: \"8b1692a0-5357-4d3d-8264-144c54fc9d14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"
Jul 23 18:35:34.496354 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.496335    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1692a0-5357-4d3d-8264-144c54fc9d14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q\" (UID: \"8b1692a0-5357-4d3d-8264-144c54fc9d14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"
Jul 23 18:35:34.592544 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.592513    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"
Jul 23 18:35:34.990115 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:34.990084    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"]
Jul 23 18:35:34.990902 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:35:34.990877    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1692a0_5357_4d3d_8264_144c54fc9d14.slice/crio-05b22333f0d341261306e094e1f18ffe291f97b907dabb50740db8d334a7b3a3 WatchSource:0}: Error finding container 05b22333f0d341261306e094e1f18ffe291f97b907dabb50740db8d334a7b3a3: Status 404 returned error can't find the container with id 05b22333f0d341261306e094e1f18ffe291f97b907dabb50740db8d334a7b3a3
Jul 23 18:35:35.176830 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:35.176796    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:35.177284 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:35.177073    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:35.177844 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:35.177825    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:35:35.598910 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:35.598873    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q" event={"ID":"8b1692a0-5357-4d3d-8264-144c54fc9d14","Type":"ContainerStarted","Data":"838e1ffaa7cc491906204346d78cbe1560189bfc16a592fe4fd56752bbe09726"}
Jul 23 18:35:35.599076 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:35.598932    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q" event={"ID":"8b1692a0-5357-4d3d-8264-144c54fc9d14","Type":"ContainerStarted","Data":"05b22333f0d341261306e094e1f18ffe291f97b907dabb50740db8d334a7b3a3"}
Jul 23 18:35:35.617592 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:35.617545    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q" podStartSLOduration=1.617530594 podStartE2EDuration="1.617530594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:35.615729322 +0000 UTC m=+2277.448420482" watchObservedRunningTime="2026-07-23 18:35:35.617530594 +0000 UTC m=+2277.450221752"
Jul 23 18:35:36.606929 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:36.606888    2572 generic.go:356] "Generic (PLEG): container finished" podID="8b1692a0-5357-4d3d-8264-144c54fc9d14" containerID="838e1ffaa7cc491906204346d78cbe1560189bfc16a592fe4fd56752bbe09726" exitCode=0
Jul 23 18:35:36.607382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:36.606970    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q" event={"ID":"8b1692a0-5357-4d3d-8264-144c54fc9d14","Type":"ContainerDied","Data":"838e1ffaa7cc491906204346d78cbe1560189bfc16a592fe4fd56752bbe09726"}
Jul 23 18:35:37.749797 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:37.749773    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"
Jul 23 18:35:37.827116 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:37.827088    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1692a0-5357-4d3d-8264-144c54fc9d14-maas-api-service-ca\") pod \"8b1692a0-5357-4d3d-8264-144c54fc9d14\" (UID: \"8b1692a0-5357-4d3d-8264-144c54fc9d14\") "
Jul 23 18:35:37.827514 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:37.827483    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b1692a0-5357-4d3d-8264-144c54fc9d14-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b1692a0-5357-4d3d-8264-144c54fc9d14" (UID: "8b1692a0-5357-4d3d-8264-144c54fc9d14"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:35:37.928316 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:37.928239    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b1692a0-5357-4d3d-8264-144c54fc9d14-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:35:38.619059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.619030    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"
Jul 23 18:35:38.619059 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.619041    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q" event={"ID":"8b1692a0-5357-4d3d-8264-144c54fc9d14","Type":"ContainerDied","Data":"05b22333f0d341261306e094e1f18ffe291f97b907dabb50740db8d334a7b3a3"}
Jul 23 18:35:38.619323 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.619114    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05b22333f0d341261306e094e1f18ffe291f97b907dabb50740db8d334a7b3a3"
Jul 23 18:35:38.620663 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.620640    2572 generic.go:356] "Generic (PLEG): container finished" podID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerID="e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873" exitCode=0
Jul 23 18:35:38.620784 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.620709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" event={"ID":"3e4e702d-c6b6-41d2-84c9-086264a3d15f","Type":"ContainerDied","Data":"e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873"}
Jul 23 18:35:38.621108 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.621084    2572 scope.go:117] "RemoveContainer" containerID="e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873"
Jul 23 18:35:38.622128 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.622103    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:38.622183 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.622167    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:38.622221 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.622201    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:35:38.859467 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:38.859426    2572 scope.go:117] "RemoveContainer" containerID="3bc35943f48cf97cfcb74c8633f914f54e03b2573abe27fdc1691623fd4f1bf9"
Jul 23 18:35:39.628208 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:39.628168    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" event={"ID":"3e4e702d-c6b6-41d2-84c9-086264a3d15f","Type":"ContainerStarted","Data":"8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9"}
Jul 23 18:35:40.117613 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:40.117584    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:40.117998 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:40.117809    2572 patch_prober.go:28] interesting pod/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 23 18:35:40.117998 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:40.117853    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 23 18:35:41.117695 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:41.117656    2572 patch_prober.go:28] interesting pod/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 23 18:35:41.118174 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:41.117713    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 23 18:35:42.118190 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:42.118153    2572 patch_prober.go:28] interesting pod/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 23 18:35:42.118630 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:42.118207    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 23 18:35:43.117811 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:43.117746    2572 patch_prober.go:28] interesting pod/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 23 18:35:43.118001 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:43.117833    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 23 18:35:44.121462 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:44.121432    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:44.121947 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:44.121819    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:44.122525 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:44.122508    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:35:54.355939 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:54.355903    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"]
Jul 23 18:35:54.360081 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:54.360053    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-debfbc-wcd6q"]
Jul 23 18:35:54.792761 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:35:54.792725    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b1692a0-5357-4d3d-8264-144c54fc9d14" path="/var/lib/kubelet/pods/8b1692a0-5357-4d3d-8264-144c54fc9d14/volumes"
Jul 23 18:36:01.304534 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.304498    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"]
Jul 23 18:36:01.305025 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.304761    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy" containerID="cri-o://fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80" gracePeriod=30
Jul 23 18:36:01.715541 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.715456    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"]
Jul 23 18:36:01.715849 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.715835    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b1692a0-5357-4d3d-8264-144c54fc9d14" containerName="revoke-keys"
Jul 23 18:36:01.715900 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.715850    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b1692a0-5357-4d3d-8264-144c54fc9d14" containerName="revoke-keys"
Jul 23 18:36:01.715936 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.715921    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b1692a0-5357-4d3d-8264-144c54fc9d14" containerName="revoke-keys"
Jul 23 18:36:01.719041 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.719024    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"
Jul 23 18:36:01.723537 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.723511    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:36:01.723537 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.723514    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:36:01.734558 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.734525    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"]
Jul 23 18:36:01.842354 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.842318    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6639fd4-7167-4cd6-aac2-0d39f4b227fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5\" (UID: \"e6639fd4-7167-4cd6-aac2-0d39f4b227fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"
Jul 23 18:36:01.943148 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.943102    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6639fd4-7167-4cd6-aac2-0d39f4b227fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5\" (UID: \"e6639fd4-7167-4cd6-aac2-0d39f4b227fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"
Jul 23 18:36:01.943780 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:01.943727    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6639fd4-7167-4cd6-aac2-0d39f4b227fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5\" (UID: \"e6639fd4-7167-4cd6-aac2-0d39f4b227fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"
Jul 23 18:36:02.028451 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:02.028412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"
Jul 23 18:36:02.167598 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:02.167571    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"]
Jul 23 18:36:02.169039 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:36:02.169010    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6639fd4_7167_4cd6_aac2_0d39f4b227fd.slice/crio-99596c9395bde7d79a1cbb349fd6e34f168459c4ecd3cab60efe8b1dc0ed3d74 WatchSource:0}: Error finding container 99596c9395bde7d79a1cbb349fd6e34f168459c4ecd3cab60efe8b1dc0ed3d74: Status 404 returned error can't find the container with id 99596c9395bde7d79a1cbb349fd6e34f168459c4ecd3cab60efe8b1dc0ed3d74
Jul 23 18:36:02.783627 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:02.783579    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5" event={"ID":"e6639fd4-7167-4cd6-aac2-0d39f4b227fd","Type":"ContainerStarted","Data":"833fac22b092feb5f9990b116af9e754f0092c251d3bbcaf683acaa201165246"}
Jul 23 18:36:02.784072 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:02.783658    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5" event={"ID":"e6639fd4-7167-4cd6-aac2-0d39f4b227fd","Type":"ContainerStarted","Data":"99596c9395bde7d79a1cbb349fd6e34f168459c4ecd3cab60efe8b1dc0ed3d74"}
Jul 23 18:36:02.802943 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:02.802891    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5" podStartSLOduration=1.8028740760000002 podStartE2EDuration="1.802874076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:02.80068532 +0000 UTC m=+2304.633376508" watchObservedRunningTime="2026-07-23 18:36:02.802874076 +0000 UTC m=+2304.635565234"
Jul 23 18:36:03.790350 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:03.790313    2572 generic.go:356] "Generic (PLEG): container finished" podID="e6639fd4-7167-4cd6-aac2-0d39f4b227fd" containerID="833fac22b092feb5f9990b116af9e754f0092c251d3bbcaf683acaa201165246" exitCode=0
Jul 23 18:36:03.790774 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:03.790394    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5" event={"ID":"e6639fd4-7167-4cd6-aac2-0d39f4b227fd","Type":"ContainerDied","Data":"833fac22b092feb5f9990b116af9e754f0092c251d3bbcaf683acaa201165246"}
Jul 23 18:36:04.934890 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:04.934855    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"
Jul 23 18:36:04.970695 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:04.970662    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6639fd4-7167-4cd6-aac2-0d39f4b227fd-maas-api-service-ca\") pod \"e6639fd4-7167-4cd6-aac2-0d39f4b227fd\" (UID: \"e6639fd4-7167-4cd6-aac2-0d39f4b227fd\") "
Jul 23 18:36:04.971097 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:04.971076    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6639fd4-7167-4cd6-aac2-0d39f4b227fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e6639fd4-7167-4cd6-aac2-0d39f4b227fd" (UID: "e6639fd4-7167-4cd6-aac2-0d39f4b227fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:36:05.072353 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:05.072260    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6639fd4-7167-4cd6-aac2-0d39f4b227fd-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:05.179779 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:05.179722    2572 patch_prober.go:28] interesting pod/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:36:05.179922 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:05.179803    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:36:05.803032 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:05.803000    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"
Jul 23 18:36:05.803245 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:05.803041    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5" event={"ID":"e6639fd4-7167-4cd6-aac2-0d39f4b227fd","Type":"ContainerDied","Data":"99596c9395bde7d79a1cbb349fd6e34f168459c4ecd3cab60efe8b1dc0ed3d74"}
Jul 23 18:36:05.803245 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:05.803087    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99596c9395bde7d79a1cbb349fd6e34f168459c4ecd3cab60efe8b1dc0ed3d74"
Jul 23 18:36:06.574650 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.574581    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:36:06.584469 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584441    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istiod-ca-cert\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-certs\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584539    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-credential-socket\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584562    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-token\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584588    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-data\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584621    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-socket\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584679    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-podinfo\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584736    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtbnx\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-kube-api-access-wtbnx\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584803    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-envoy\") pod \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\" (UID: \"2e007f88-5166-4beb-9cd3-41f68b5ec9f9\") "
Jul 23 18:36:06.584895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584866    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:06.584895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584878    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:06.585239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.584843    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:36:06.585239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.585085    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:06.585239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.585170    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.585239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.585190    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.585239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.585204    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.585239 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.585218    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.585814 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.585792    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:06.587009 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.586974    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:06.587104 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.587082    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-kube-api-access-wtbnx" (OuterVolumeSpecName: "kube-api-access-wtbnx") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "kube-api-access-wtbnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:36:06.587238 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.587219    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:36:06.587287 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.587238    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e007f88-5166-4beb-9cd3-41f68b5ec9f9" (UID: "2e007f88-5166-4beb-9cd3-41f68b5ec9f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:36:06.685867 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.685823    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.685867 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.685859    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.685867 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.685869    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.686109 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.685878    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtbnx\" (UniqueName: \"kubernetes.io/projected/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-kube-api-access-wtbnx\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.686109 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.685889    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e007f88-5166-4beb-9cd3-41f68b5ec9f9-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:06.809465 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.809433    2572 generic.go:356] "Generic (PLEG): container finished" podID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerID="fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80" exitCode=0
Jul 23 18:36:06.809622 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.809480    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"
Jul 23 18:36:06.809622 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.809517    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" event={"ID":"2e007f88-5166-4beb-9cd3-41f68b5ec9f9","Type":"ContainerDied","Data":"fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80"}
Jul 23 18:36:06.809622 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.809576    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh" event={"ID":"2e007f88-5166-4beb-9cd3-41f68b5ec9f9","Type":"ContainerDied","Data":"d7979fdfa0fbeecefe9ae6e227b1c0a2f4a2908c091fcb0862f11dcbd66c488b"}
Jul 23 18:36:06.809622 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.809606    2572 scope.go:117] "RemoveContainer" containerID="fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80"
Jul 23 18:36:06.818931 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.818912    2572 scope.go:117] "RemoveContainer" containerID="9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474"
Jul 23 18:36:06.827121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.827102    2572 scope.go:117] "RemoveContainer" containerID="fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80"
Jul 23 18:36:06.827386 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:36:06.827366    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80\": container with ID starting with fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80 not found: ID does not exist" containerID="fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80"
Jul 23 18:36:06.827437 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.827395    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80"} err="failed to get container status \"fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80\": rpc error: code = NotFound desc = could not find container \"fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80\": container with ID starting with fa0b4fffbd899bc3e71d3970a9f2417b6a6089e50005d6957aa5e7ba013cfe80 not found: ID does not exist"
Jul 23 18:36:06.827437 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.827413    2572 scope.go:117] "RemoveContainer" containerID="9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474"
Jul 23 18:36:06.827674 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:36:06.827657    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474\": container with ID starting with 9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474 not found: ID does not exist" containerID="9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474"
Jul 23 18:36:06.827723 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.827692    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474"} err="failed to get container status \"9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474\": rpc error: code = NotFound desc = could not find container \"9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474\": container with ID starting with 9f9e384d4984f5338e1f28cb4893131a5bfb4ef2aec10122d2244f1c872bf474 not found: ID does not exist"
Jul 23 18:36:06.835902 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.835875    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"]
Jul 23 18:36:06.840960 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:06.840930    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-debfbc-openshift-default-864444dbff-mrhzh"]
Jul 23 18:36:08.793018 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:08.792980    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" path="/var/lib/kubelet/pods/2e007f88-5166-4beb-9cd3-41f68b5ec9f9/volumes"
Jul 23 18:36:21.792547 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:21.792514    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"]
Jul 23 18:36:21.794608 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:21.794588    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0bce45-lwbc5"]
Jul 23 18:36:22.793022 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:22.792973    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6639fd4-7167-4cd6-aac2-0d39f4b227fd" path="/var/lib/kubelet/pods/e6639fd4-7167-4cd6-aac2-0d39f4b227fd/volumes"
Jul 23 18:36:28.571911 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:28.571875    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"]
Jul 23 18:36:28.572472 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:28.572073    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy" containerID="cri-o://8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9" gracePeriod=30
Jul 23 18:36:29.124203 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.124169    2572 patch_prober.go:28] interesting pod/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:36:29.124370 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.124227    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:36:29.515943 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.515917    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"]
Jul 23 18:36:29.516273 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.516261    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy"
Jul 23 18:36:29.516317 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.516275    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy"
Jul 23 18:36:29.516317 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.516293    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6639fd4-7167-4cd6-aac2-0d39f4b227fd" containerName="revoke-keys"
Jul 23 18:36:29.516317 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.516298    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6639fd4-7167-4cd6-aac2-0d39f4b227fd" containerName="revoke-keys"
Jul 23 18:36:29.516410 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.516355    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy"
Jul 23 18:36:29.516410 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.516366    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6639fd4-7167-4cd6-aac2-0d39f4b227fd" containerName="revoke-keys"
Jul 23 18:36:29.519562 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.519544    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.522182 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.522162    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e94d59-openshift-default-dockercfg-gkt2x\""
Jul 23 18:36:29.533952 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.533927    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"]
Jul 23 18:36:29.585290 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585260    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-envoy\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.585290 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585290    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istiod-ca-cert\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.585641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585316    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-socket\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.585641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585401    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-data\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.585641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-podinfo\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.585641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-token\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.585641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585503    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-certs\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.585641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk962\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-kube-api-access-wk962\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.585641 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.585550    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-credential-socket\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.686447 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-certs\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.686632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk962\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-kube-api-access-wk962\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.686632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686475    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-credential-socket\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.686632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686523    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-envoy\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.686632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istiod-ca-cert\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.686632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-socket\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.686632 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-data\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.687003 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-podinfo\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.687003 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-token\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.687003 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686836    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-certs\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.687003 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.686927    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-credential-socket\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.687167 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.687090    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-data\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.687205 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.687185    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-socket\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.687334 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.687313    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istiod-ca-cert\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.688957 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.688930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-envoy\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.689340 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.689314    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-podinfo\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.702168 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.702129    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-token\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.704424 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.704399    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk962\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-kube-api-access-wk962\") pod \"e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") " pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.830592 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.830318    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:29.973316 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.973286    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"]
Jul 23 18:36:29.974262 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:36:29.974235    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef94e76d_f0ad_4231_9f76_11eba0c3d47d.slice/crio-875f7014ae8241602ff96a15f995c296350163531f5effc0f8851100657fef19 WatchSource:0}: Error finding container 875f7014ae8241602ff96a15f995c296350163531f5effc0f8851100657fef19: Status 404 returned error can't find the container with id 875f7014ae8241602ff96a15f995c296350163531f5effc0f8851100657fef19
Jul 23 18:36:29.976260 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.976223    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:29.976356 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.976302    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:29.976356 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:29.976346    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:30.948900 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:30.948858    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" event={"ID":"ef94e76d-f0ad-4231-9f76-11eba0c3d47d","Type":"ContainerStarted","Data":"a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d"}
Jul 23 18:36:30.949321 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:30.948927    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" event={"ID":"ef94e76d-f0ad-4231-9f76-11eba0c3d47d","Type":"ContainerStarted","Data":"875f7014ae8241602ff96a15f995c296350163531f5effc0f8851100657fef19"}
Jul 23 18:36:30.971813 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:30.971714    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" podStartSLOduration=1.9716988610000001 podStartE2EDuration="1.971698861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:30.970817789 +0000 UTC m=+2332.803508946" watchObservedRunningTime="2026-07-23 18:36:30.971698861 +0000 UTC m=+2332.804390017"
Jul 23 18:36:31.834831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:31.834792    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:31.839466 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:31.839442    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:31.954438 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:31.954409    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:31.955228 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:31.955213    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:33.834774 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.834699    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:36:33.923188 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923149    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-token\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923380 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923196    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-envoy\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923380 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923321    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-credential-socket\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923510 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923389    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qqzb\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-kube-api-access-2qqzb\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923510 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923437    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-socket\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923510 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923471    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-podinfo\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923510 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923495    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istiod-ca-cert\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923723 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923525    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-certs\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923723 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923555    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-data\") pod \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\" (UID: \"3e4e702d-c6b6-41d2-84c9-086264a3d15f\") "
Jul 23 18:36:33.923723 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923703    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:33.923956 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923933    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:33.923956 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.923937    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:33.924212 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.924175    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:33.924548 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.924520    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:36:33.925081 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.925047    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:33.926534 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.926493    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-kube-api-access-2qqzb" (OuterVolumeSpecName: "kube-api-access-2qqzb") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "kube-api-access-2qqzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:36:33.926771 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.926729    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:36:33.926956 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.926928    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:36:33.926956 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.926927    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e4e702d-c6b6-41d2-84c9-086264a3d15f" (UID: "3e4e702d-c6b6-41d2-84c9-086264a3d15f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:36:33.967610 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.967583    2572 generic.go:356] "Generic (PLEG): container finished" podID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerID="8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9" exitCode=0
Jul 23 18:36:33.967774 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.967632    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"
Jul 23 18:36:33.967774 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.967657    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" event={"ID":"3e4e702d-c6b6-41d2-84c9-086264a3d15f","Type":"ContainerDied","Data":"8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9"}
Jul 23 18:36:33.967774 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.967707    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j" event={"ID":"3e4e702d-c6b6-41d2-84c9-086264a3d15f","Type":"ContainerDied","Data":"3c875cfd89da2913b5cfdc748d6e17fbb4095a0525bd9bfad964635c93977f31"}
Jul 23 18:36:33.967774 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.967729    2572 scope.go:117] "RemoveContainer" containerID="8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9"
Jul 23 18:36:33.977039 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.977004    2572 scope.go:117] "RemoveContainer" containerID="e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873"
Jul 23 18:36:33.985048 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.985010    2572 scope.go:117] "RemoveContainer" containerID="8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9"
Jul 23 18:36:33.985292 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:36:33.985274    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9\": container with ID starting with 8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9 not found: ID does not exist" containerID="8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9"
Jul 23 18:36:33.985341 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.985301    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9"} err="failed to get container status \"8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9\": rpc error: code = NotFound desc = could not find container \"8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9\": container with ID starting with 8df38fbdf952f0d5355dbecefe900af6ce3320e52a773d6d39ac7630188ed6b9 not found: ID does not exist"
Jul 23 18:36:33.985341 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.985322    2572 scope.go:117] "RemoveContainer" containerID="e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873"
Jul 23 18:36:33.985547 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:36:33.985530    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873\": container with ID starting with e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873 not found: ID does not exist" containerID="e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873"
Jul 23 18:36:33.985582 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.985552    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873"} err="failed to get container status \"e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873\": rpc error: code = NotFound desc = could not find container \"e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873\": container with ID starting with e11f8b581a1ccb272def86dbccb5ea5510c62950f9d30cb3ef9adcdcdc2ea873 not found: ID does not exist"
Jul 23 18:36:33.991892 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.991873    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"]
Jul 23 18:36:33.995767 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:33.995741    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0bce45-openshift-default-67cbbddcbc-9gc8j"]
Jul 23 18:36:34.024564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.024546    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:34.024564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.024562    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:34.024681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.024572    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:34.024681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.024581    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qqzb\" (UniqueName: \"kubernetes.io/projected/3e4e702d-c6b6-41d2-84c9-086264a3d15f-kube-api-access-2qqzb\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:34.024681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.024591    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:34.024681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.024600    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:34.024681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.024608    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:34.024681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.024615    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e702d-c6b6-41d2-84c9-086264a3d15f-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:36:34.792981 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:34.792930    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" path="/var/lib/kubelet/pods/3e4e702d-c6b6-41d2-84c9-086264a3d15f/volumes"
Jul 23 18:36:38.188912 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.188879    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"]
Jul 23 18:36:38.189288 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.189261    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy"
Jul 23 18:36:38.189288 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.189273    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy"
Jul 23 18:36:38.189288 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.189285    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy"
Jul 23 18:36:38.189288 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.189290    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy"
Jul 23 18:36:38.189425 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.189298    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy"
Jul 23 18:36:38.189425 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.189305    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy"
Jul 23 18:36:38.189425 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.189354    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy"
Jul 23 18:36:38.189425 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.189362    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e007f88-5166-4beb-9cd3-41f68b5ec9f9" containerName="istio-proxy"
Jul 23 18:36:38.193803 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.193782    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.196680 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.196662    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f5044c-openshift-default-dockercfg-nvvgh\""
Jul 23 18:36:38.207679 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.207660    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"]
Jul 23 18:36:38.359029 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.358994    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-envoy\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.359029 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.359027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf9gw\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-kube-api-access-hf9gw\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.359223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.359052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-podinfo\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.359223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.359083    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-data\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.359223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.359111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-credential-socket\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.359223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.359155    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istiod-ca-cert\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.359223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.359195    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-socket\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.359376 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.359240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-token\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.359376 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.359279    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-certs\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460664 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460575    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-token\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460664 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460638    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-certs\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-envoy\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460695    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf9gw\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-kube-api-access-hf9gw\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460721    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-podinfo\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460772    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-data\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460809    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-credential-socket\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460841    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istiod-ca-cert\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.460909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.460869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-socket\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.461299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.461072    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-certs\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.461299 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.461261    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-socket\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.461420 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.461405    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-credential-socket\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.461463 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.461447    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-data\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.461786 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.461741    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istiod-ca-cert\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.463150 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.463125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-envoy\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.463430 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.463408    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-podinfo\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.468911 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.468884    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-token\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.469070 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.469054    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf9gw\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-kube-api-access-hf9gw\") pod \"e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") " pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.505984 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.505967    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f5044c-openshift-default-dockercfg-nvvgh\""
Jul 23 18:36:38.513282 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.513264    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:38.650794 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.650768    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"]
Jul 23 18:36:38.652293 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:36:38.652267    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e10026_db22_4b0d_b57e_e623ae1ab2a9.slice/crio-48735241c7d3467124be8b5a18f72d680cd2bcfb88aa0bf53fa0d9ae94371598 WatchSource:0}: Error finding container 48735241c7d3467124be8b5a18f72d680cd2bcfb88aa0bf53fa0d9ae94371598: Status 404 returned error can't find the container with id 48735241c7d3467124be8b5a18f72d680cd2bcfb88aa0bf53fa0d9ae94371598
Jul 23 18:36:38.654263 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.654228    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:38.654331 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.654302    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:38.654373 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.654332    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:38.898850 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.898821    2572 scope.go:117] "RemoveContainer" containerID="319292cc80f1a6683ec43b1d4427e2d402e8785ab4a2a41f1074c9eedcda7afb"
Jul 23 18:36:38.908829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.908806    2572 scope.go:117] "RemoveContainer" containerID="5c7fa67f5793256ac07282388ed0d75b6efdfc55225b2b7fb63ec4339b31d4d9"
Jul 23 18:36:38.996915 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.996880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" event={"ID":"f4e10026-db22-4b0d-b57e-e623ae1ab2a9","Type":"ContainerStarted","Data":"3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f"}
Jul 23 18:36:38.997051 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:38.996945    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" event={"ID":"f4e10026-db22-4b0d-b57e-e623ae1ab2a9","Type":"ContainerStarted","Data":"48735241c7d3467124be8b5a18f72d680cd2bcfb88aa0bf53fa0d9ae94371598"}
Jul 23 18:36:39.019149 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:39.018696    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" podStartSLOduration=1.018676422 podStartE2EDuration="1.018676422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:39.017500601 +0000 UTC m=+2340.850191759" watchObservedRunningTime="2026-07-23 18:36:39.018676422 +0000 UTC m=+2340.851367580"
Jul 23 18:36:39.514405 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:39.514376    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:39.518882 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:39.518859    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:40.002787 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:40.002696    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:40.003674 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:40.003653    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:47.995880 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:47.995844    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 18:36:47.996298 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:47.995912    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 18:36:49.054736 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:49.054701    2572 generic.go:356] "Generic (PLEG): container finished" podID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerID="a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d" exitCode=0
Jul 23 18:36:49.055223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:49.054777    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" event={"ID":"ef94e76d-f0ad-4231-9f76-11eba0c3d47d","Type":"ContainerDied","Data":"a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d"}
Jul 23 18:36:49.055223 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:49.055150    2572 scope.go:117] "RemoveContainer" containerID="a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d"
Jul 23 18:36:49.056137 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:49.056110    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:49.056205 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:49.056188    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:49.056255 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:49.056238    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:50.064024 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:50.063977    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" event={"ID":"ef94e76d-f0ad-4231-9f76-11eba0c3d47d","Type":"ContainerStarted","Data":"99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff"}
Jul 23 18:36:50.834629 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:50.834590    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:50.834853 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:50.834712    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Jul 23 18:36:50.834853 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:50.834775    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Jul 23 18:36:51.834743 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:51.834696    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Jul 23 18:36:51.835258 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:51.834797    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Jul 23 18:36:52.834629 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:52.834594    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Jul 23 18:36:52.834927 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:52.834895    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Jul 23 18:36:53.835566 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:53.835149    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Jul 23 18:36:53.835566 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:53.835206    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Jul 23 18:36:54.839084 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:54.839047    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:54.839517 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:54.839430    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:54.840144 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:54.840123    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:36:56.044944 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:56.044890    2572 patch_prober.go:28] interesting pod/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 18:36:56.045357 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:56.044952    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 18:36:57.111585 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:57.111507    2572 generic.go:356] "Generic (PLEG): container finished" podID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerID="3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f" exitCode=0
Jul 23 18:36:57.111999 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:57.111581    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" event={"ID":"f4e10026-db22-4b0d-b57e-e623ae1ab2a9","Type":"ContainerDied","Data":"3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f"}
Jul 23 18:36:57.111999 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:57.111976    2572 scope.go:117] "RemoveContainer" containerID="3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f"
Jul 23 18:36:57.113041 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:57.113013    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:57.113112 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:57.113092    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:57.113149 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:57.113134    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:36:58.119139 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.119109    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" event={"ID":"f4e10026-db22-4b0d-b57e-e623ae1ab2a9","Type":"ContainerStarted","Data":"c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9"}
Jul 23 18:36:58.513522 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.513491    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:36:58.513735 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.513712    2572 patch_prober.go:28] interesting pod/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 23 18:36:58.513846 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.513796    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 23 18:36:58.524410 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.524382    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"]
Jul 23 18:36:58.524843 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.524828    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e4e702d-c6b6-41d2-84c9-086264a3d15f" containerName="istio-proxy"
Jul 23 18:36:58.551494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.551461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.554682 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.554654    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"]
Jul 23 18:36:58.561224 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.561180    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e94d59\"/\"kube-root-ca.crt\""
Jul 23 18:36:58.561366 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.561276    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e94d59\"/\"openshift-service-ca.crt\""
Jul 23 18:36:58.562121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.562092    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e94d59\"/\"default-dockercfg-6mnfs\""
Jul 23 18:36:58.562121 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.562107    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e94d59\"/\"auth-test-model-e94d59-kserve-self-signed-certs\""
Jul 23 18:36:58.652312 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.652257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-dshm\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.652523 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.652324    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tmp-dir\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.652523 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.652436    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-model-cache\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.652523 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.652473    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-home\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.652697 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.652558    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tls-certs\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.652697 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.652598    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppl29\" (UniqueName: \"kubernetes.io/projected/5d3e0df9-355c-43cb-8384-a75969ca4ca2-kube-api-access-ppl29\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.754098 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.754059    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-home\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.754425 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.754400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tls-certs\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.754574 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.754555    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppl29\" (UniqueName: \"kubernetes.io/projected/5d3e0df9-355c-43cb-8384-a75969ca4ca2-kube-api-access-ppl29\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.754778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.754735    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-dshm\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.754937 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.754905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tmp-dir\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.755066 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.754984    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-model-cache\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.755826 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.755779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tmp-dir\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.755938 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.755895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-model-cache\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.755938 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.755897    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-home\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.757604 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.757565    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-dshm\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.758272 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.758242    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tls-certs\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.767022 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.766966    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppl29\" (UniqueName: \"kubernetes.io/projected/5d3e0df9-355c-43cb-8384-a75969ca4ca2-kube-api-access-ppl29\") pod \"auth-test-model-e94d59-kserve-5b67c6f987-xvdr9\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") " pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:58.865372 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:58.865329    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:36:59.038099 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:59.037946    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"]
Jul 23 18:36:59.060193 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:36:59.060162    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d3e0df9_355c_43cb_8384_a75969ca4ca2.slice/crio-2c0b61ab561f5c364fa54ae6bbae02b44a6a8f0437ed9fdefb2f11ffebd616f0 WatchSource:0}: Error finding container 2c0b61ab561f5c364fa54ae6bbae02b44a6a8f0437ed9fdefb2f11ffebd616f0: Status 404 returned error can't find the container with id 2c0b61ab561f5c364fa54ae6bbae02b44a6a8f0437ed9fdefb2f11ffebd616f0
Jul 23 18:36:59.140205 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:59.140173    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9" event={"ID":"5d3e0df9-355c-43cb-8384-a75969ca4ca2","Type":"ContainerStarted","Data":"2c0b61ab561f5c364fa54ae6bbae02b44a6a8f0437ed9fdefb2f11ffebd616f0"}
Jul 23 18:36:59.514404 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:59.514372    2572 patch_prober.go:28] interesting pod/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 23 18:36:59.514561 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:36:59.514432    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 23 18:37:00.150825 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:00.150786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9" event={"ID":"5d3e0df9-355c-43cb-8384-a75969ca4ca2","Type":"ContainerStarted","Data":"46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e"}
Jul 23 18:37:00.172472 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:00.172424    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9" podStartSLOduration=2.172410045 podStartE2EDuration="2.172410045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:37:00.170797051 +0000 UTC m=+2362.003488229" watchObservedRunningTime="2026-07-23 18:37:00.172410045 +0000 UTC m=+2362.005101202"
Jul 23 18:37:00.513854 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:00.513822    2572 patch_prober.go:28] interesting pod/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 23 18:37:00.514027 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:00.513879    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 23 18:37:01.514001 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:01.513962    2572 patch_prober.go:28] interesting pod/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 23 18:37:01.514448 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:01.514022    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 23 18:37:02.518484 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:02.518445    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:37:02.518991 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:02.518971    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:37:02.519784 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:02.519746    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:37:08.865530 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:08.865488    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:37:08.866006 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:08.865577    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:37:08.878099 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:08.878069    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:37:09.211504 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:37:09.211432    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:39:59.207461 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:39:59.207411    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"]
Jul 23 18:40:14.229335 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.229275    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9" podUID="5d3e0df9-355c-43cb-8384-a75969ca4ca2" containerName="main" containerID="cri-o://46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e" gracePeriod=45
Jul 23 18:40:14.485770 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.485692    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:40:14.561290 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561258    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppl29\" (UniqueName: \"kubernetes.io/projected/5d3e0df9-355c-43cb-8384-a75969ca4ca2-kube-api-access-ppl29\") pod \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") "
Jul 23 18:40:14.561455 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561309    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tmp-dir\") pod \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") "
Jul 23 18:40:14.561455 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561331    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-model-cache\") pod \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") "
Jul 23 18:40:14.561455 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561359    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-home\") pod \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") "
Jul 23 18:40:14.561455 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561397    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-dshm\") pod \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") "
Jul 23 18:40:14.561673 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561477    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tls-certs\") pod \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\" (UID: \"5d3e0df9-355c-43cb-8384-a75969ca4ca2\") "
Jul 23 18:40:14.561673 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561629    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d3e0df9-355c-43cb-8384-a75969ca4ca2" (UID: "5d3e0df9-355c-43cb-8384-a75969ca4ca2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:40:14.561673 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561617    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d3e0df9-355c-43cb-8384-a75969ca4ca2" (UID: "5d3e0df9-355c-43cb-8384-a75969ca4ca2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:40:14.561673 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561645    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-home" (OuterVolumeSpecName: "home") pod "5d3e0df9-355c-43cb-8384-a75969ca4ca2" (UID: "5d3e0df9-355c-43cb-8384-a75969ca4ca2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:40:14.561957 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561801    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-home\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:40:14.561957 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561816    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tmp-dir\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:40:14.561957 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.561825    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-model-cache\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:40:14.563625 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.563592    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d3e0df9-355c-43cb-8384-a75969ca4ca2-kube-api-access-ppl29" (OuterVolumeSpecName: "kube-api-access-ppl29") pod "5d3e0df9-355c-43cb-8384-a75969ca4ca2" (UID: "5d3e0df9-355c-43cb-8384-a75969ca4ca2"). InnerVolumeSpecName "kube-api-access-ppl29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:40:14.563780 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.563645    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d3e0df9-355c-43cb-8384-a75969ca4ca2" (UID: "5d3e0df9-355c-43cb-8384-a75969ca4ca2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:40:14.563780 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.563645    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-dshm" (OuterVolumeSpecName: "dshm") pod "5d3e0df9-355c-43cb-8384-a75969ca4ca2" (UID: "5d3e0df9-355c-43cb-8384-a75969ca4ca2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:40:14.662836 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.662802    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d3e0df9-355c-43cb-8384-a75969ca4ca2-dshm\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:40:14.662836 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.662829    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d3e0df9-355c-43cb-8384-a75969ca4ca2-tls-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:40:14.662836 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:14.662839    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppl29\" (UniqueName: \"kubernetes.io/projected/5d3e0df9-355c-43cb-8384-a75969ca4ca2-kube-api-access-ppl29\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:40:15.255494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.255402    2572 generic.go:356] "Generic (PLEG): container finished" podID="5d3e0df9-355c-43cb-8384-a75969ca4ca2" containerID="46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e" exitCode=0
Jul 23 18:40:15.255494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.255445    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"
Jul 23 18:40:15.255494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.255449    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9" event={"ID":"5d3e0df9-355c-43cb-8384-a75969ca4ca2","Type":"ContainerDied","Data":"46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e"}
Jul 23 18:40:15.255494 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.255484    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9" event={"ID":"5d3e0df9-355c-43cb-8384-a75969ca4ca2","Type":"ContainerDied","Data":"2c0b61ab561f5c364fa54ae6bbae02b44a6a8f0437ed9fdefb2f11ffebd616f0"}
Jul 23 18:40:15.256087 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.255507    2572 scope.go:117] "RemoveContainer" containerID="46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e"
Jul 23 18:40:15.264616 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.264596    2572 scope.go:117] "RemoveContainer" containerID="46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e"
Jul 23 18:40:15.264929 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:40:15.264895    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e\": container with ID starting with 46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e not found: ID does not exist" containerID="46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e"
Jul 23 18:40:15.265016 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.264943    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e"} err="failed to get container status \"46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e\": rpc error: code = NotFound desc = could not find container \"46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e\": container with ID starting with 46963bb817abc0483a4b4d6fca0783704ecee1592307084315d45d63fd38485e not found: ID does not exist"
Jul 23 18:40:15.277923 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.277894    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"]
Jul 23 18:40:15.286856 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:15.286830    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e94d59/auth-test-model-e94d59-kserve-5b67c6f987-xvdr9"]
Jul 23 18:40:16.794372 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:16.794340    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d3e0df9-355c-43cb-8384-a75969ca4ca2" path="/var/lib/kubelet/pods/5d3e0df9-355c-43cb-8384-a75969ca4ca2/volumes"
Jul 23 18:40:18.092308 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.092269    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"]
Jul 23 18:40:18.092840 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.092823    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d3e0df9-355c-43cb-8384-a75969ca4ca2" containerName="main"
Jul 23 18:40:18.092886 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.092843    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d3e0df9-355c-43cb-8384-a75969ca4ca2" containerName="main"
Jul 23 18:40:18.092979 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.092968    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d3e0df9-355c-43cb-8384-a75969ca4ca2" containerName="main"
Jul 23 18:40:18.096500 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.096480    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.101878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.101850    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f5044c\"/\"openshift-service-ca.crt\""
Jul 23 18:40:18.102029 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.101911    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f5044c\"/\"kube-root-ca.crt\""
Jul 23 18:40:18.102926 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.102896    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f5044c\"/\"sub-test-model-f5044c-kserve-self-signed-certs\""
Jul 23 18:40:18.103079 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.102964    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f5044c\"/\"default-dockercfg-z9t5b\""
Jul 23 18:40:18.109150 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.109128    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"]
Jul 23 18:40:18.193405 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.193362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-tmp-dir\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.193602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.193419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpt7\" (UniqueName: \"kubernetes.io/projected/2ee69215-9113-41d0-87fe-aa0858744a37-kube-api-access-wnpt7\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.193602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.193514    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-dshm\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.193602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.193547    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-model-cache\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.193602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.193591    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-home\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.193797 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.193618    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ee69215-9113-41d0-87fe-aa0858744a37-tls-certs\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.298778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.295293    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-home\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.298778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.295359    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ee69215-9113-41d0-87fe-aa0858744a37-tls-certs\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.298778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.295439    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-tmp-dir\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.298778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.295489    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpt7\" (UniqueName: \"kubernetes.io/projected/2ee69215-9113-41d0-87fe-aa0858744a37-kube-api-access-wnpt7\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.298778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.295557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-dshm\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.298778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.295583    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-model-cache\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.298778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.296059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-model-cache\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.298778 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.296304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-home\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.302382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.302304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-tmp-dir\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.303416 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.303011    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ee69215-9113-41d0-87fe-aa0858744a37-tls-certs\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.306901 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.306873    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-dshm\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.312201 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.312177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpt7\" (UniqueName: \"kubernetes.io/projected/2ee69215-9113-41d0-87fe-aa0858744a37-kube-api-access-wnpt7\") pod \"sub-test-model-f5044c-kserve-779cf6999-6kd77\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") " pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.406961 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.406876    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:18.552798 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:18.552771    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"]
Jul 23 18:40:18.553588 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:40:18.553563    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ee69215_9113_41d0_87fe_aa0858744a37.slice/crio-85aff3e830c1ef087b9636a247f301d394aab3aafd6e27ea5648634390e1d404 WatchSource:0}: Error finding container 85aff3e830c1ef087b9636a247f301d394aab3aafd6e27ea5648634390e1d404: Status 404 returned error can't find the container with id 85aff3e830c1ef087b9636a247f301d394aab3aafd6e27ea5648634390e1d404
Jul 23 18:40:19.278890 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:19.278850    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77" event={"ID":"2ee69215-9113-41d0-87fe-aa0858744a37","Type":"ContainerStarted","Data":"8141e639dcd35a540f18fe2a9c73507638879c2c27f66ac8147d960bc45defa6"}
Jul 23 18:40:19.279288 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:19.278900    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77" event={"ID":"2ee69215-9113-41d0-87fe-aa0858744a37","Type":"ContainerStarted","Data":"85aff3e830c1ef087b9636a247f301d394aab3aafd6e27ea5648634390e1d404"}
Jul 23 18:40:19.303527 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:19.303475    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77" podStartSLOduration=1.303460652 podStartE2EDuration="1.303460652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:40:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:19.300941728 +0000 UTC m=+2561.133632887" watchObservedRunningTime="2026-07-23 18:40:19.303460652 +0000 UTC m=+2561.136151830"
Jul 23 18:40:28.407895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:28.407843    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:28.407895 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:28.407904    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:28.420426 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:28.420399    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:29.344498 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:29.344466    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:40:38.971963 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:40:38.971926    2572 scope.go:117] "RemoveContainer" containerID="9147e38c74c10c5c621abdd496a2bb677b58dd0287e0e0dcb993cfa0fc6299df"
Jul 23 18:41:01.375644 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:01.375561    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"]
Jul 23 18:41:16.395785 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.395723    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77" podUID="2ee69215-9113-41d0-87fe-aa0858744a37" containerName="main" containerID="cri-o://8141e639dcd35a540f18fe2a9c73507638879c2c27f66ac8147d960bc45defa6" gracePeriod=45
Jul 23 18:41:16.597050 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.597019    2572 generic.go:356] "Generic (PLEG): container finished" podID="2ee69215-9113-41d0-87fe-aa0858744a37" containerID="8141e639dcd35a540f18fe2a9c73507638879c2c27f66ac8147d960bc45defa6" exitCode=0
Jul 23 18:41:16.597230 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.597078    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77" event={"ID":"2ee69215-9113-41d0-87fe-aa0858744a37","Type":"ContainerDied","Data":"8141e639dcd35a540f18fe2a9c73507638879c2c27f66ac8147d960bc45defa6"}
Jul 23 18:41:16.654047 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.653990    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:41:16.730667 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.730636    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-tmp-dir\") pod \"2ee69215-9113-41d0-87fe-aa0858744a37\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") "
Jul 23 18:41:16.730874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.730676    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ee69215-9113-41d0-87fe-aa0858744a37-tls-certs\") pod \"2ee69215-9113-41d0-87fe-aa0858744a37\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") "
Jul 23 18:41:16.730874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.730716    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-dshm\") pod \"2ee69215-9113-41d0-87fe-aa0858744a37\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") "
Jul 23 18:41:16.730874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.730811    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnpt7\" (UniqueName: \"kubernetes.io/projected/2ee69215-9113-41d0-87fe-aa0858744a37-kube-api-access-wnpt7\") pod \"2ee69215-9113-41d0-87fe-aa0858744a37\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") "
Jul 23 18:41:16.730874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.730835    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-model-cache\") pod \"2ee69215-9113-41d0-87fe-aa0858744a37\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") "
Jul 23 18:41:16.730874 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.730858    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-home\") pod \"2ee69215-9113-41d0-87fe-aa0858744a37\" (UID: \"2ee69215-9113-41d0-87fe-aa0858744a37\") "
Jul 23 18:41:16.731220 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.730965    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2ee69215-9113-41d0-87fe-aa0858744a37" (UID: "2ee69215-9113-41d0-87fe-aa0858744a37"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:16.731220 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.731171    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-tmp-dir\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:41:16.731220 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.731160    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-model-cache" (OuterVolumeSpecName: "model-cache") pod "2ee69215-9113-41d0-87fe-aa0858744a37" (UID: "2ee69215-9113-41d0-87fe-aa0858744a37"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:16.731390 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.731281    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-home" (OuterVolumeSpecName: "home") pod "2ee69215-9113-41d0-87fe-aa0858744a37" (UID: "2ee69215-9113-41d0-87fe-aa0858744a37"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:16.733336 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.733309    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ee69215-9113-41d0-87fe-aa0858744a37-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ee69215-9113-41d0-87fe-aa0858744a37" (UID: "2ee69215-9113-41d0-87fe-aa0858744a37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:41:16.733485 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.733466    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-dshm" (OuterVolumeSpecName: "dshm") pod "2ee69215-9113-41d0-87fe-aa0858744a37" (UID: "2ee69215-9113-41d0-87fe-aa0858744a37"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:41:16.733552 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.733512    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ee69215-9113-41d0-87fe-aa0858744a37-kube-api-access-wnpt7" (OuterVolumeSpecName: "kube-api-access-wnpt7") pod "2ee69215-9113-41d0-87fe-aa0858744a37" (UID: "2ee69215-9113-41d0-87fe-aa0858744a37"). InnerVolumeSpecName "kube-api-access-wnpt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:41:16.832034 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.831919    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnpt7\" (UniqueName: \"kubernetes.io/projected/2ee69215-9113-41d0-87fe-aa0858744a37-kube-api-access-wnpt7\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:41:16.832034 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.831954    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-model-cache\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:41:16.832034 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.831968    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-home\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:41:16.832034 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.831982    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ee69215-9113-41d0-87fe-aa0858744a37-tls-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:41:16.832034 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:16.831996    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ee69215-9113-41d0-87fe-aa0858744a37-dshm\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:41:17.603961 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:17.603927    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"
Jul 23 18:41:17.604411 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:17.603957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77" event={"ID":"2ee69215-9113-41d0-87fe-aa0858744a37","Type":"ContainerDied","Data":"85aff3e830c1ef087b9636a247f301d394aab3aafd6e27ea5648634390e1d404"}
Jul 23 18:41:17.604411 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:17.604009    2572 scope.go:117] "RemoveContainer" containerID="8141e639dcd35a540f18fe2a9c73507638879c2c27f66ac8147d960bc45defa6"
Jul 23 18:41:17.628949 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:17.628900    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"]
Jul 23 18:41:17.630988 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:17.630966    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/sub-test-model-f5044c-kserve-779cf6999-6kd77"]
Jul 23 18:41:18.792761 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:18.792715    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ee69215-9113-41d0-87fe-aa0858744a37" path="/var/lib/kubelet/pods/2ee69215-9113-41d0-87fe-aa0858744a37/volumes"
Jul 23 18:41:38.999884 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:38.999856    2572 scope.go:117] "RemoveContainer" containerID="08d6dfa40a3224fb68cf0d7ce9a42d712660731ae2bc96d2352663f9c051456c"
Jul 23 18:41:39.008495 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.008474    2572 scope.go:117] "RemoveContainer" containerID="838e1ffaa7cc491906204346d78cbe1560189bfc16a592fe4fd56752bbe09726"
Jul 23 18:41:39.503675 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.503641    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"]
Jul 23 18:41:39.504115 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.504088    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ee69215-9113-41d0-87fe-aa0858744a37" containerName="main"
Jul 23 18:41:39.504115 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.504115    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ee69215-9113-41d0-87fe-aa0858744a37" containerName="main"
Jul 23 18:41:39.504303 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.504224    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ee69215-9113-41d0-87fe-aa0858744a37" containerName="main"
Jul 23 18:41:39.508619 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.508600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.511568 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.511547    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f5044c\"/\"openshift-service-ca.crt\""
Jul 23 18:41:39.511667 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.511645    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f5044c\"/\"default-dockercfg-z9t5b\""
Jul 23 18:41:39.512715 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.512694    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f5044c\"/\"kube-root-ca.crt\""
Jul 23 18:41:39.512830 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.512735    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f5044c\"/\"rate-test-model-f5044c-kserve-self-signed-certs\""
Jul 23 18:41:39.536341 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.536310    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"]
Jul 23 18:41:39.634678 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.634639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b17978-61f9-4878-a683-e20157c06ab9-tls-certs\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.634878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.634705    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-home\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.634878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.634741    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-tmp-dir\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.635017 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.634880    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-model-cache\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.635017 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.634937    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8lv\" (UniqueName: \"kubernetes.io/projected/39b17978-61f9-4878-a683-e20157c06ab9-kube-api-access-nf8lv\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.635017 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.634974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-dshm\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.735922 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.735887    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-model-cache\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.736091 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.735933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8lv\" (UniqueName: \"kubernetes.io/projected/39b17978-61f9-4878-a683-e20157c06ab9-kube-api-access-nf8lv\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.736091 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.736046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-dshm\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.736176 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.736103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b17978-61f9-4878-a683-e20157c06ab9-tls-certs\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.736176 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.736144    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-home\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.736176 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.736162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-tmp-dir\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.736327 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.736269    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-model-cache\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.736468 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.736446    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-home\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.736541 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.736466    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-tmp-dir\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.738247 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.738227    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-dshm\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.738613 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.738593    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b17978-61f9-4878-a683-e20157c06ab9-tls-certs\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.744676 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.744654    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8lv\" (UniqueName: \"kubernetes.io/projected/39b17978-61f9-4878-a683-e20157c06ab9-kube-api-access-nf8lv\") pod \"rate-test-model-f5044c-kserve-bdf887ff9-d9bmx\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") " pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.817415 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.817388    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:39.955633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:39.955612    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"]
Jul 23 18:41:39.957074 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:41:39.957041    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b17978_61f9_4878_a683_e20157c06ab9.slice/crio-02a4959fc440413abc94a443a6cce9d170998cb1f10b6af82201dc2dd6e665d2 WatchSource:0}: Error finding container 02a4959fc440413abc94a443a6cce9d170998cb1f10b6af82201dc2dd6e665d2: Status 404 returned error can't find the container with id 02a4959fc440413abc94a443a6cce9d170998cb1f10b6af82201dc2dd6e665d2
Jul 23 18:41:40.732339 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:40.732302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx" event={"ID":"39b17978-61f9-4878-a683-e20157c06ab9","Type":"ContainerStarted","Data":"d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1"}
Jul 23 18:41:40.732850 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:40.732355    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx" event={"ID":"39b17978-61f9-4878-a683-e20157c06ab9","Type":"ContainerStarted","Data":"02a4959fc440413abc94a443a6cce9d170998cb1f10b6af82201dc2dd6e665d2"}
Jul 23 18:41:40.756854 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:40.756808    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx" podStartSLOduration=1.7567934649999999 podStartE2EDuration="1.756793465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:41:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:41:40.755420132 +0000 UTC m=+2642.588111288" watchObservedRunningTime="2026-07-23 18:41:40.756793465 +0000 UTC m=+2642.589484621"
Jul 23 18:41:49.818380 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:49.818349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:49.818859 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:49.818412    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:49.831143 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:49.831119    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:41:50.803963 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:41:50.803935    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:42:37.705139 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:37.705056    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"]
Jul 23 18:42:38.741663 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:38.741634    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7585-140210904464176"]
Jul 23 18:42:38.745207 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:38.745186    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904464176"
Jul 23 18:42:38.748030 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:38.748005    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mr4c9\""
Jul 23 18:42:38.752532 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:38.752501    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7585-140210904464176"]
Jul 23 18:42:38.861181 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:38.861152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbmh\" (UniqueName: \"kubernetes.io/projected/2d4cfaca-fbf0-4678-8d1d-9632374b3d77-kube-api-access-jrbmh\") pod \"test-curl-7585-140210904464176\" (UID: \"2d4cfaca-fbf0-4678-8d1d-9632374b3d77\") " pod="opendatahub/test-curl-7585-140210904464176"
Jul 23 18:42:38.962356 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:38.962322    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbmh\" (UniqueName: \"kubernetes.io/projected/2d4cfaca-fbf0-4678-8d1d-9632374b3d77-kube-api-access-jrbmh\") pod \"test-curl-7585-140210904464176\" (UID: \"2d4cfaca-fbf0-4678-8d1d-9632374b3d77\") " pod="opendatahub/test-curl-7585-140210904464176"
Jul 23 18:42:38.972081 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:38.972051    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbmh\" (UniqueName: \"kubernetes.io/projected/2d4cfaca-fbf0-4678-8d1d-9632374b3d77-kube-api-access-jrbmh\") pod \"test-curl-7585-140210904464176\" (UID: \"2d4cfaca-fbf0-4678-8d1d-9632374b3d77\") " pod="opendatahub/test-curl-7585-140210904464176"
Jul 23 18:42:39.035719 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:39.035687    2572 scope.go:117] "RemoveContainer" containerID="833fac22b092feb5f9990b116af9e754f0092c251d3bbcaf683acaa201165246"
Jul 23 18:42:39.057091 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:39.057072    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904464176"
Jul 23 18:42:39.188316 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:39.188291    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7585-140210904464176"]
Jul 23 18:42:39.189742 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:42:39.189717    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d4cfaca_fbf0_4678_8d1d_9632374b3d77.slice/crio-1bc2e8d95534e01cb06c2828ad87652ae799ea4c5453ed5142756c67d4ca6f29 WatchSource:0}: Error finding container 1bc2e8d95534e01cb06c2828ad87652ae799ea4c5453ed5142756c67d4ca6f29: Status 404 returned error can't find the container with id 1bc2e8d95534e01cb06c2828ad87652ae799ea4c5453ed5142756c67d4ca6f29
Jul 23 18:42:39.191125 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:39.191107    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:42:40.063040 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:40.063010    2572 generic.go:356] "Generic (PLEG): container finished" podID="2d4cfaca-fbf0-4678-8d1d-9632374b3d77" containerID="04f8ec73e9c3fe70a22736dab08faba86d7e032688e3c609886f4277eefdf842" exitCode=0
Jul 23 18:42:40.063389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:40.063099    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7585-140210904464176" event={"ID":"2d4cfaca-fbf0-4678-8d1d-9632374b3d77","Type":"ContainerDied","Data":"04f8ec73e9c3fe70a22736dab08faba86d7e032688e3c609886f4277eefdf842"}
Jul 23 18:42:40.063389 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:40.063150    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7585-140210904464176" event={"ID":"2d4cfaca-fbf0-4678-8d1d-9632374b3d77","Type":"ContainerStarted","Data":"1bc2e8d95534e01cb06c2828ad87652ae799ea4c5453ed5142756c67d4ca6f29"}
Jul 23 18:42:41.200133 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:41.200112    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904464176"
Jul 23 18:42:41.246686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:41.246656    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7585-140210904464176_2d4cfaca-fbf0-4678-8d1d-9632374b3d77/test-curl-7585-140210904464176/0.log"
Jul 23 18:42:41.276737 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:41.276708    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7585-140210904464176"]
Jul 23 18:42:41.281422 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:41.281397    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrbmh\" (UniqueName: \"kubernetes.io/projected/2d4cfaca-fbf0-4678-8d1d-9632374b3d77-kube-api-access-jrbmh\") pod \"2d4cfaca-fbf0-4678-8d1d-9632374b3d77\" (UID: \"2d4cfaca-fbf0-4678-8d1d-9632374b3d77\") "
Jul 23 18:42:41.283611 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:41.283580    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4cfaca-fbf0-4678-8d1d-9632374b3d77-kube-api-access-jrbmh" (OuterVolumeSpecName: "kube-api-access-jrbmh") pod "2d4cfaca-fbf0-4678-8d1d-9632374b3d77" (UID: "2d4cfaca-fbf0-4678-8d1d-9632374b3d77"). InnerVolumeSpecName "kube-api-access-jrbmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:42:41.283727 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:41.283713    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7585-140210904464176"]
Jul 23 18:42:41.382542 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:41.382470    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrbmh\" (UniqueName: \"kubernetes.io/projected/2d4cfaca-fbf0-4678-8d1d-9632374b3d77-kube-api-access-jrbmh\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:42.075030 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:42.075004    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904464176"
Jul 23 18:42:42.075205 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:42.075051    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bc2e8d95534e01cb06c2828ad87652ae799ea4c5453ed5142756c67d4ca6f29"
Jul 23 18:42:42.085132 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:42:42.085107    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7585-140210904464176\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="2d4cfaca-fbf0-4678-8d1d-9632374b3d77" pod="opendatahub/test-curl-7585-140210904464176"
Jul 23 18:42:42.798846 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:42.798813    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d4cfaca-fbf0-4678-8d1d-9632374b3d77" path="/var/lib/kubelet/pods/2d4cfaca-fbf0-4678-8d1d-9632374b3d77/volumes"
Jul 23 18:42:45.059942 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.059906    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7585-140210904409408"]
Jul 23 18:42:45.060382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.060262    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d4cfaca-fbf0-4678-8d1d-9632374b3d77" containerName="test-curl-7585-140210904464176"
Jul 23 18:42:45.060382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.060273    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d4cfaca-fbf0-4678-8d1d-9632374b3d77" containerName="test-curl-7585-140210904464176"
Jul 23 18:42:45.060382 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.060338    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d4cfaca-fbf0-4678-8d1d-9632374b3d77" containerName="test-curl-7585-140210904464176"
Jul 23 18:42:45.063532 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.063517    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:45.066456 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.066432    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mr4c9\""
Jul 23 18:42:45.068466 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.068444    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7585-140210904409408"]
Jul 23 18:42:45.218383 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.218348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg266\" (UniqueName: \"kubernetes.io/projected/558f64aa-910a-438a-8f93-e0ceddf3fdcf-kube-api-access-dg266\") pod \"test-curl-7585-140210904409408\" (UID: \"558f64aa-910a-438a-8f93-e0ceddf3fdcf\") " pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:45.319790 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.319692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg266\" (UniqueName: \"kubernetes.io/projected/558f64aa-910a-438a-8f93-e0ceddf3fdcf-kube-api-access-dg266\") pod \"test-curl-7585-140210904409408\" (UID: \"558f64aa-910a-438a-8f93-e0ceddf3fdcf\") " pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:45.334387 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.334365    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg266\" (UniqueName: \"kubernetes.io/projected/558f64aa-910a-438a-8f93-e0ceddf3fdcf-kube-api-access-dg266\") pod \"test-curl-7585-140210904409408\" (UID: \"558f64aa-910a-438a-8f93-e0ceddf3fdcf\") " pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:45.372819 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.372796    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:45.508172 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:45.508148    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7585-140210904409408"]
Jul 23 18:42:45.509783 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:42:45.509740    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod558f64aa_910a_438a_8f93_e0ceddf3fdcf.slice/crio-6f14df1c9c7ce92244ad22f6dcb9ea9b8581320c48dec9c8597c152c03513229 WatchSource:0}: Error finding container 6f14df1c9c7ce92244ad22f6dcb9ea9b8581320c48dec9c8597c152c03513229: Status 404 returned error can't find the container with id 6f14df1c9c7ce92244ad22f6dcb9ea9b8581320c48dec9c8597c152c03513229
Jul 23 18:42:46.096664 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:46.096574    2572 generic.go:356] "Generic (PLEG): container finished" podID="558f64aa-910a-438a-8f93-e0ceddf3fdcf" containerID="b29f56a3f29de98de12a07e813d8f8997f676badccb78bf77c6c9fafe277c791" exitCode=0
Jul 23 18:42:46.097064 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:46.096663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7585-140210904409408" event={"ID":"558f64aa-910a-438a-8f93-e0ceddf3fdcf","Type":"ContainerDied","Data":"b29f56a3f29de98de12a07e813d8f8997f676badccb78bf77c6c9fafe277c791"}
Jul 23 18:42:46.097064 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:46.096704    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7585-140210904409408" event={"ID":"558f64aa-910a-438a-8f93-e0ceddf3fdcf","Type":"ContainerStarted","Data":"6f14df1c9c7ce92244ad22f6dcb9ea9b8581320c48dec9c8597c152c03513229"}
Jul 23 18:42:47.232424 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:47.232398    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:47.274394 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:47.274365    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7585-140210904409408_558f64aa-910a-438a-8f93-e0ceddf3fdcf/test-curl-7585-140210904409408/0.log"
Jul 23 18:42:47.301588 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:47.301551    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7585-140210904409408"]
Jul 23 18:42:47.303842 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:47.303814    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7585-140210904409408"]
Jul 23 18:42:47.337218 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:47.337183    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg266\" (UniqueName: \"kubernetes.io/projected/558f64aa-910a-438a-8f93-e0ceddf3fdcf-kube-api-access-dg266\") pod \"558f64aa-910a-438a-8f93-e0ceddf3fdcf\" (UID: \"558f64aa-910a-438a-8f93-e0ceddf3fdcf\") "
Jul 23 18:42:47.339297 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:47.339274    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/558f64aa-910a-438a-8f93-e0ceddf3fdcf-kube-api-access-dg266" (OuterVolumeSpecName: "kube-api-access-dg266") pod "558f64aa-910a-438a-8f93-e0ceddf3fdcf" (UID: "558f64aa-910a-438a-8f93-e0ceddf3fdcf"). InnerVolumeSpecName "kube-api-access-dg266". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:42:47.438661 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:47.438585    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg266\" (UniqueName: \"kubernetes.io/projected/558f64aa-910a-438a-8f93-e0ceddf3fdcf-kube-api-access-dg266\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:48.115662 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:48.115630    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:48.115861 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:48.115636    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f14df1c9c7ce92244ad22f6dcb9ea9b8581320c48dec9c8597c152c03513229"
Jul 23 18:42:48.126175 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:42:48.126137    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7585-140210904409408\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="558f64aa-910a-438a-8f93-e0ceddf3fdcf" pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:48.792769 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:42:48.792717    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7585-140210904409408\" is forbidden: User \"system:node:ip-10-0-129-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-70.ec2.internal' and this object" podUID="558f64aa-910a-438a-8f93-e0ceddf3fdcf" pod="opendatahub/test-curl-7585-140210904409408"
Jul 23 18:42:48.793596 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:48.793575    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="558f64aa-910a-438a-8f93-e0ceddf3fdcf" path="/var/lib/kubelet/pods/558f64aa-910a-438a-8f93-e0ceddf3fdcf/volumes"
Jul 23 18:42:50.034201 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.034167    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7585-140210904409120"]
Jul 23 18:42:50.034565 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.034524    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="558f64aa-910a-438a-8f93-e0ceddf3fdcf" containerName="test-curl-7585-140210904409408"
Jul 23 18:42:50.034565 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.034536    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="558f64aa-910a-438a-8f93-e0ceddf3fdcf" containerName="test-curl-7585-140210904409408"
Jul 23 18:42:50.034640 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.034600    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="558f64aa-910a-438a-8f93-e0ceddf3fdcf" containerName="test-curl-7585-140210904409408"
Jul 23 18:42:50.037705 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.037687    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904409120"
Jul 23 18:42:50.040614 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.040593    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mr4c9\""
Jul 23 18:42:50.048378 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.048356    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7585-140210904409120"]
Jul 23 18:42:50.058849 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.058817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qg98\" (UniqueName: \"kubernetes.io/projected/1f413234-1229-4743-8f1d-9628651b2c1e-kube-api-access-8qg98\") pod \"test-curl-7585-140210904409120\" (UID: \"1f413234-1229-4743-8f1d-9628651b2c1e\") " pod="opendatahub/test-curl-7585-140210904409120"
Jul 23 18:42:50.160032 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.159996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qg98\" (UniqueName: \"kubernetes.io/projected/1f413234-1229-4743-8f1d-9628651b2c1e-kube-api-access-8qg98\") pod \"test-curl-7585-140210904409120\" (UID: \"1f413234-1229-4743-8f1d-9628651b2c1e\") " pod="opendatahub/test-curl-7585-140210904409120"
Jul 23 18:42:50.169737 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.169717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qg98\" (UniqueName: \"kubernetes.io/projected/1f413234-1229-4743-8f1d-9628651b2c1e-kube-api-access-8qg98\") pod \"test-curl-7585-140210904409120\" (UID: \"1f413234-1229-4743-8f1d-9628651b2c1e\") " pod="opendatahub/test-curl-7585-140210904409120"
Jul 23 18:42:50.346988 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.346905    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904409120"
Jul 23 18:42:50.487010 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:50.486984    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7585-140210904409120"]
Jul 23 18:42:50.488099 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:42:50.488066    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f413234_1229_4743_8f1d_9628651b2c1e.slice/crio-c1fc7e8c506251fdcffdc84095928cc73330182fbcc18c35ab74265a4fb84786 WatchSource:0}: Error finding container c1fc7e8c506251fdcffdc84095928cc73330182fbcc18c35ab74265a4fb84786: Status 404 returned error can't find the container with id c1fc7e8c506251fdcffdc84095928cc73330182fbcc18c35ab74265a4fb84786
Jul 23 18:42:51.133908 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:51.133819    2572 generic.go:356] "Generic (PLEG): container finished" podID="1f413234-1229-4743-8f1d-9628651b2c1e" containerID="7956e4dcdca655fe73c6e716a425c2e4ad91fc92dfccd149407bdf656982a48f" exitCode=0
Jul 23 18:42:51.133908 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:51.133891    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7585-140210904409120" event={"ID":"1f413234-1229-4743-8f1d-9628651b2c1e","Type":"ContainerDied","Data":"7956e4dcdca655fe73c6e716a425c2e4ad91fc92dfccd149407bdf656982a48f"}
Jul 23 18:42:51.134328 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:51.133924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7585-140210904409120" event={"ID":"1f413234-1229-4743-8f1d-9628651b2c1e","Type":"ContainerStarted","Data":"c1fc7e8c506251fdcffdc84095928cc73330182fbcc18c35ab74265a4fb84786"}
Jul 23 18:42:52.268183 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.268161    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904409120"
Jul 23 18:42:52.275654 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.275636    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qg98\" (UniqueName: \"kubernetes.io/projected/1f413234-1229-4743-8f1d-9628651b2c1e-kube-api-access-8qg98\") pod \"1f413234-1229-4743-8f1d-9628651b2c1e\" (UID: \"1f413234-1229-4743-8f1d-9628651b2c1e\") "
Jul 23 18:42:52.277602 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.277574    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f413234-1229-4743-8f1d-9628651b2c1e-kube-api-access-8qg98" (OuterVolumeSpecName: "kube-api-access-8qg98") pod "1f413234-1229-4743-8f1d-9628651b2c1e" (UID: "1f413234-1229-4743-8f1d-9628651b2c1e"). InnerVolumeSpecName "kube-api-access-8qg98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:42:52.307397 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.307367    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7585-140210904409120_1f413234-1229-4743-8f1d-9628651b2c1e/test-curl-7585-140210904409120/0.log"
Jul 23 18:42:52.343522 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.343487    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7585-140210904409120"]
Jul 23 18:42:52.348005 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.347982    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7585-140210904409120"]
Jul 23 18:42:52.377036 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.377010    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qg98\" (UniqueName: \"kubernetes.io/projected/1f413234-1229-4743-8f1d-9628651b2c1e-kube-api-access-8qg98\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:52.733274 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.733229    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx" podUID="39b17978-61f9-4878-a683-e20157c06ab9" containerName="main" containerID="cri-o://d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1" gracePeriod=45
Jul 23 18:42:52.798547 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.798512    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f413234-1229-4743-8f1d-9628651b2c1e" path="/var/lib/kubelet/pods/1f413234-1229-4743-8f1d-9628651b2c1e/volumes"
Jul 23 18:42:52.983193 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:52.983169    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:42:53.081273 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081237    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b17978-61f9-4878-a683-e20157c06ab9-tls-certs\") pod \"39b17978-61f9-4878-a683-e20157c06ab9\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") "
Jul 23 18:42:53.081564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081290    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-model-cache\") pod \"39b17978-61f9-4878-a683-e20157c06ab9\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") "
Jul 23 18:42:53.081564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081319    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-tmp-dir\") pod \"39b17978-61f9-4878-a683-e20157c06ab9\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") "
Jul 23 18:42:53.081564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081346    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-dshm\") pod \"39b17978-61f9-4878-a683-e20157c06ab9\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") "
Jul 23 18:42:53.081564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081413    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-home\") pod \"39b17978-61f9-4878-a683-e20157c06ab9\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") "
Jul 23 18:42:53.081564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081455    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf8lv\" (UniqueName: \"kubernetes.io/projected/39b17978-61f9-4878-a683-e20157c06ab9-kube-api-access-nf8lv\") pod \"39b17978-61f9-4878-a683-e20157c06ab9\" (UID: \"39b17978-61f9-4878-a683-e20157c06ab9\") "
Jul 23 18:42:53.081564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081531    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-model-cache" (OuterVolumeSpecName: "model-cache") pod "39b17978-61f9-4878-a683-e20157c06ab9" (UID: "39b17978-61f9-4878-a683-e20157c06ab9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:42:53.081564 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081549    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "39b17978-61f9-4878-a683-e20157c06ab9" (UID: "39b17978-61f9-4878-a683-e20157c06ab9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:42:53.081955 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081677    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-home" (OuterVolumeSpecName: "home") pod "39b17978-61f9-4878-a683-e20157c06ab9" (UID: "39b17978-61f9-4878-a683-e20157c06ab9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:42:53.081955 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081779    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-tmp-dir\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:53.081955 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081793    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-home\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:53.081955 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.081802    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-model-cache\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:53.083378 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.083356    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-dshm" (OuterVolumeSpecName: "dshm") pod "39b17978-61f9-4878-a683-e20157c06ab9" (UID: "39b17978-61f9-4878-a683-e20157c06ab9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:42:53.083453 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.083358    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b17978-61f9-4878-a683-e20157c06ab9-kube-api-access-nf8lv" (OuterVolumeSpecName: "kube-api-access-nf8lv") pod "39b17978-61f9-4878-a683-e20157c06ab9" (UID: "39b17978-61f9-4878-a683-e20157c06ab9"). InnerVolumeSpecName "kube-api-access-nf8lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:42:53.083453 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.083388    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b17978-61f9-4878-a683-e20157c06ab9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "39b17978-61f9-4878-a683-e20157c06ab9" (UID: "39b17978-61f9-4878-a683-e20157c06ab9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:42:53.146566 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.146537    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7585-140210904409120"
Jul 23 18:42:53.146566 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.146566    2572 scope.go:117] "RemoveContainer" containerID="7956e4dcdca655fe73c6e716a425c2e4ad91fc92dfccd149407bdf656982a48f"
Jul 23 18:42:53.148008 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.147987    2572 generic.go:356] "Generic (PLEG): container finished" podID="39b17978-61f9-4878-a683-e20157c06ab9" containerID="d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1" exitCode=0
Jul 23 18:42:53.148102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.148036    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"
Jul 23 18:42:53.148102 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.148072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx" event={"ID":"39b17978-61f9-4878-a683-e20157c06ab9","Type":"ContainerDied","Data":"d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1"}
Jul 23 18:42:53.148197 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.148112    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx" event={"ID":"39b17978-61f9-4878-a683-e20157c06ab9","Type":"ContainerDied","Data":"02a4959fc440413abc94a443a6cce9d170998cb1f10b6af82201dc2dd6e665d2"}
Jul 23 18:42:53.156479 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.156438    2572 scope.go:117] "RemoveContainer" containerID="d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1"
Jul 23 18:42:53.164362 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.164347    2572 scope.go:117] "RemoveContainer" containerID="d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1"
Jul 23 18:42:53.164592 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:42:53.164574    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1\": container with ID starting with d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1 not found: ID does not exist" containerID="d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1"
Jul 23 18:42:53.164633 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.164602    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1"} err="failed to get container status \"d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1\": rpc error: code = NotFound desc = could not find container \"d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1\": container with ID starting with d222a385e5e7a46be208ee63d9d1a87982e767be9c3b020bbab34394854434a1 not found: ID does not exist"
Jul 23 18:42:53.173365 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.173343    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"]
Jul 23 18:42:53.179572 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.179554    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f5044c/rate-test-model-f5044c-kserve-bdf887ff9-d9bmx"]
Jul 23 18:42:53.182483 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.182468    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf8lv\" (UniqueName: \"kubernetes.io/projected/39b17978-61f9-4878-a683-e20157c06ab9-kube-api-access-nf8lv\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:53.182551 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.182485    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39b17978-61f9-4878-a683-e20157c06ab9-tls-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:53.182551 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:53.182496    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39b17978-61f9-4878-a683-e20157c06ab9-dshm\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:54.793146 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:54.793115    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b17978-61f9-4878-a683-e20157c06ab9" path="/var/lib/kubelet/pods/39b17978-61f9-4878-a683-e20157c06ab9/volumes"
Jul 23 18:42:55.117097 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.116994    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"]
Jul 23 18:42:55.117402 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.117390    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b17978-61f9-4878-a683-e20157c06ab9" containerName="main"
Jul 23 18:42:55.117444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.117403    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b17978-61f9-4878-a683-e20157c06ab9" containerName="main"
Jul 23 18:42:55.117444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.117415    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f413234-1229-4743-8f1d-9628651b2c1e" containerName="test-curl-7585-140210904409120"
Jul 23 18:42:55.117444 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.117421    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f413234-1229-4743-8f1d-9628651b2c1e" containerName="test-curl-7585-140210904409120"
Jul 23 18:42:55.117546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.117497    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f413234-1229-4743-8f1d-9628651b2c1e" containerName="test-curl-7585-140210904409120"
Jul 23 18:42:55.117546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.117505    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="39b17978-61f9-4878-a683-e20157c06ab9" containerName="main"
Jul 23 18:42:55.122144 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.122127    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"
Jul 23 18:42:55.125142 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.125119    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:42:55.125381 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.125366    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:42:55.130066 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.130043    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"]
Jul 23 18:42:55.198960 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.198918    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01af7ae7-f541-4f64-b44a-5ede967db7e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw\" (UID: \"01af7ae7-f541-4f64-b44a-5ede967db7e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"
Jul 23 18:42:55.300050 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.300012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01af7ae7-f541-4f64-b44a-5ede967db7e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw\" (UID: \"01af7ae7-f541-4f64-b44a-5ede967db7e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"
Jul 23 18:42:55.300614 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.300595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01af7ae7-f541-4f64-b44a-5ede967db7e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw\" (UID: \"01af7ae7-f541-4f64-b44a-5ede967db7e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"
Jul 23 18:42:55.433374 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.433294    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"
Jul 23 18:42:55.573369 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:55.573340    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"]
Jul 23 18:42:55.574939 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:42:55.574906    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01af7ae7_f541_4f64_b44a_5ede967db7e7.slice/crio-aafc4425678d6b781ca8dbd89543c997b2072528176edaec80bbde454c02186f WatchSource:0}: Error finding container aafc4425678d6b781ca8dbd89543c997b2072528176edaec80bbde454c02186f: Status 404 returned error can't find the container with id aafc4425678d6b781ca8dbd89543c997b2072528176edaec80bbde454c02186f
Jul 23 18:42:56.166817 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:56.166789    2572 generic.go:356] "Generic (PLEG): container finished" podID="01af7ae7-f541-4f64-b44a-5ede967db7e7" containerID="cb367fe0cbaaa192f003acd61c3e40cb7372d7e59379188ca2034732961c2699" exitCode=0
Jul 23 18:42:56.167147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:56.166870    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw" event={"ID":"01af7ae7-f541-4f64-b44a-5ede967db7e7","Type":"ContainerDied","Data":"cb367fe0cbaaa192f003acd61c3e40cb7372d7e59379188ca2034732961c2699"}
Jul 23 18:42:56.167147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:56.166922    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw" event={"ID":"01af7ae7-f541-4f64-b44a-5ede967db7e7","Type":"ContainerStarted","Data":"aafc4425678d6b781ca8dbd89543c997b2072528176edaec80bbde454c02186f"}
Jul 23 18:42:57.316819 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:57.316796    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"
Jul 23 18:42:57.419019 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:57.418990    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01af7ae7-f541-4f64-b44a-5ede967db7e7-maas-api-service-ca\") pod \"01af7ae7-f541-4f64-b44a-5ede967db7e7\" (UID: \"01af7ae7-f541-4f64-b44a-5ede967db7e7\") "
Jul 23 18:42:57.419359 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:57.419337    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01af7ae7-f541-4f64-b44a-5ede967db7e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01af7ae7-f541-4f64-b44a-5ede967db7e7" (UID: "01af7ae7-f541-4f64-b44a-5ede967db7e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:42:57.519619 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:57.519592    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01af7ae7-f541-4f64-b44a-5ede967db7e7-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:42:58.178676 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:58.178643    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw" event={"ID":"01af7ae7-f541-4f64-b44a-5ede967db7e7","Type":"ContainerDied","Data":"aafc4425678d6b781ca8dbd89543c997b2072528176edaec80bbde454c02186f"}
Jul 23 18:42:58.178676 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:58.178670    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"
Jul 23 18:42:58.178904 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:42:58.178691    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aafc4425678d6b781ca8dbd89543c997b2072528176edaec80bbde454c02186f"
Jul 23 18:43:10.255865 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:10.255828    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"]
Jul 23 18:43:10.259722 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:10.259696    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-e94d59-2cdmw"]
Jul 23 18:43:10.792489 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:10.792455    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01af7ae7-f541-4f64-b44a-5ede967db7e7" path="/var/lib/kubelet/pods/01af7ae7-f541-4f64-b44a-5ede967db7e7/volumes"
Jul 23 18:43:17.422980 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.422941    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"]
Jul 23 18:43:17.423352 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.423184    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy" containerID="cri-o://99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff" gracePeriod=30
Jul 23 18:43:17.830823 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.830784    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"]
Jul 23 18:43:17.831216 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.831201    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01af7ae7-f541-4f64-b44a-5ede967db7e7" containerName="revoke-keys"
Jul 23 18:43:17.831281 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.831217    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="01af7ae7-f541-4f64-b44a-5ede967db7e7" containerName="revoke-keys"
Jul 23 18:43:17.831281 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.831276    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="01af7ae7-f541-4f64-b44a-5ede967db7e7" containerName="revoke-keys"
Jul 23 18:43:17.834343 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.834321    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"
Jul 23 18:43:17.837053 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.837030    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:43:17.837196 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.837030    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-97xhw\""
Jul 23 18:43:17.853737 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.853703    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"]
Jul 23 18:43:17.904502 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:17.904464    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws\" (UID: \"8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"
Jul 23 18:43:18.005321 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:18.005286    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws\" (UID: \"8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"
Jul 23 18:43:18.005964 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:18.005944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws\" (UID: \"8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"
Jul 23 18:43:18.144733 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:18.144660    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"
Jul 23 18:43:18.281613 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:18.281588    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"]
Jul 23 18:43:18.283525 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:43:18.283492    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8293a092_ad7e_4c0c_8a99_5a5ad0f4c2b7.slice/crio-a4ceb21f23353732e4cb0c9dc83d851a6cf0df6f77bc0fceb20a9f65b14fd721 WatchSource:0}: Error finding container a4ceb21f23353732e4cb0c9dc83d851a6cf0df6f77bc0fceb20a9f65b14fd721: Status 404 returned error can't find the container with id a4ceb21f23353732e4cb0c9dc83d851a6cf0df6f77bc0fceb20a9f65b14fd721
Jul 23 18:43:19.294308 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:19.294271    2572 generic.go:356] "Generic (PLEG): container finished" podID="8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7" containerID="95aabb68d86178b6d24063192f4f7f6b85fe5bf5410f11abcacdf398ec7c8c10" exitCode=0
Jul 23 18:43:19.294686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:19.294361    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws" event={"ID":"8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7","Type":"ContainerDied","Data":"95aabb68d86178b6d24063192f4f7f6b85fe5bf5410f11abcacdf398ec7c8c10"}
Jul 23 18:43:19.294686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:19.294413    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws" event={"ID":"8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7","Type":"ContainerStarted","Data":"a4ceb21f23353732e4cb0c9dc83d851a6cf0df6f77bc0fceb20a9f65b14fd721"}
Jul 23 18:43:20.436127 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:20.436102    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"
Jul 23 18:43:20.527740 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:20.527706    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7-maas-api-service-ca\") pod \"8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7\" (UID: \"8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7\") "
Jul 23 18:43:20.528168 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:20.528137    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7" (UID: "8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:43:20.629487 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:20.629402    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7-maas-api-service-ca\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:21.305499 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:21.305463    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws" event={"ID":"8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7","Type":"ContainerDied","Data":"a4ceb21f23353732e4cb0c9dc83d851a6cf0df6f77bc0fceb20a9f65b14fd721"}
Jul 23 18:43:21.305673 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:21.305515    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4ceb21f23353732e4cb0c9dc83d851a6cf0df6f77bc0fceb20a9f65b14fd721"
Jul 23 18:43:21.305673 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:21.305480    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"
Jul 23 18:43:22.684598 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.684540    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:43:22.748149 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748123    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istiod-ca-cert\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748323 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748165    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-envoy\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748323 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748182    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-certs\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748323 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748207    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-credential-socket\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748323 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748252    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk962\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-kube-api-access-wk962\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748323 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748292    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-data\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748323 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748316    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-podinfo\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748594 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748353    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-socket\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748594 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748419    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-token\") pod \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\" (UID: \"ef94e76d-f0ad-4231-9f76-11eba0c3d47d\") "
Jul 23 18:43:22.748594 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748524    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:22.748594 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748543    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:43:22.748834 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748770    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:22.748834 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748796    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:22.748834 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748823    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:22.749023 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.748908    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:22.749385 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.749358    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:22.750492 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.750458    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:43:22.750596 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.750506    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:22.750829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.750809    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:43:22.750829 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.750815    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-kube-api-access-wk962" (OuterVolumeSpecName: "kube-api-access-wk962") pod "ef94e76d-f0ad-4231-9f76-11eba0c3d47d" (UID: "ef94e76d-f0ad-4231-9f76-11eba0c3d47d"). InnerVolumeSpecName "kube-api-access-wk962". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:43:22.849678 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.849653    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:22.849816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.849680    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:22.849816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.849694    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:22.849816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.849704    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk962\" (UniqueName: \"kubernetes.io/projected/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-kube-api-access-wk962\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:22.849816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.849713    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:22.849816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.849721    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:22.849816 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:22.849730    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef94e76d-f0ad-4231-9f76-11eba0c3d47d-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:23.318705 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.318667    2572 generic.go:356] "Generic (PLEG): container finished" podID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerID="99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff" exitCode=0
Jul 23 18:43:23.318909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.318712    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"
Jul 23 18:43:23.318909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.318744    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" event={"ID":"ef94e76d-f0ad-4231-9f76-11eba0c3d47d","Type":"ContainerDied","Data":"99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff"}
Jul 23 18:43:23.318909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.318814    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d" event={"ID":"ef94e76d-f0ad-4231-9f76-11eba0c3d47d","Type":"ContainerDied","Data":"875f7014ae8241602ff96a15f995c296350163531f5effc0f8851100657fef19"}
Jul 23 18:43:23.318909 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.318837    2572 scope.go:117] "RemoveContainer" containerID="99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff"
Jul 23 18:43:23.328430 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.328414    2572 scope.go:117] "RemoveContainer" containerID="a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d"
Jul 23 18:43:23.336265 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.336250    2572 scope.go:117] "RemoveContainer" containerID="99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff"
Jul 23 18:43:23.336584 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:43:23.336560    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff\": container with ID starting with 99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff not found: ID does not exist" containerID="99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff"
Jul 23 18:43:23.336728 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.336597    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff"} err="failed to get container status \"99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff\": rpc error: code = NotFound desc = could not find container \"99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff\": container with ID starting with 99970f63de1bc4cf9c041b1f56b5b26229477723efca980acbef28f2eac2b2ff not found: ID does not exist"
Jul 23 18:43:23.336728 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.336621    2572 scope.go:117] "RemoveContainer" containerID="a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d"
Jul 23 18:43:23.337147 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:43:23.337029    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d\": container with ID starting with a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d not found: ID does not exist" containerID="a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d"
Jul 23 18:43:23.337147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.337058    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d"} err="failed to get container status \"a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d\": rpc error: code = NotFound desc = could not find container \"a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d\": container with ID starting with a8f31e02faf3308a9b72cda36fde9a9641fe9179897f6ef08da849a021cb218d not found: ID does not exist"
Jul 23 18:43:23.339613 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.339595    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"]
Jul 23 18:43:23.343076 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:23.343056    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e94d59-openshift-default-7496b996c-6cf8d"]
Jul 23 18:43:24.792275 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:24.792242    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" path="/var/lib/kubelet/pods/ef94e76d-f0ad-4231-9f76-11eba0c3d47d/volumes"
Jul 23 18:43:32.917686 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:32.917647    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"]
Jul 23 18:43:32.920336 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:32.920312    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f5044c-ghvws"]
Jul 23 18:43:34.796766 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:34.796720    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7" path="/var/lib/kubelet/pods/8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7/volumes"
Jul 23 18:43:39.972435 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:39.972391    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"]
Jul 23 18:43:39.972912 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:39.972629    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy" containerID="cri-o://c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9" gracePeriod=30
Jul 23 18:43:45.225681 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.225655    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:43:45.257588 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257523    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-certs\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.257588 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257560    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-socket\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.257831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257625    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-data\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.257831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257647    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-podinfo\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.257831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257683    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istiod-ca-cert\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.257831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257709    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-token\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.257831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257738    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:45.257831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257778    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf9gw\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-kube-api-access-hf9gw\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.257831 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257808    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-envoy\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.258203 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257841    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-credential-socket\") pod \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\" (UID: \"f4e10026-db22-4b0d-b57e-e623ae1ab2a9\") "
Jul 23 18:43:45.258203 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.257926    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:45.258203 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.258128    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-certs\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.258203 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.258146    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-workload-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.258203 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.258190    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:45.258466 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.258310    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:43:45.258580 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.258552    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:45.260051 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.260015    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-kube-api-access-hf9gw" (OuterVolumeSpecName: "kube-api-access-hf9gw") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "kube-api-access-hf9gw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:43:45.260179 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.260054    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:43:45.260347 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.260315    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:43:45.260435 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.260347    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4e10026-db22-4b0d-b57e-e623ae1ab2a9" (UID: "f4e10026-db22-4b0d-b57e-e623ae1ab2a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:43:45.358762 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.358729    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-data\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.358917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.358776    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-podinfo\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.358917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.358787    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istiod-ca-cert\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.358917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.358795    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-token\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.358917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.358803    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf9gw\" (UniqueName: \"kubernetes.io/projected/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-kube-api-access-hf9gw\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.358917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.358813    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-istio-envoy\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.358917 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.358820    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4e10026-db22-4b0d-b57e-e623ae1ab2a9-credential-socket\") on node \"ip-10-0-129-70.ec2.internal\" DevicePath \"\""
Jul 23 18:43:45.437171 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.437127    2572 generic.go:356] "Generic (PLEG): container finished" podID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerID="c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9" exitCode=0
Jul 23 18:43:45.437358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.437187    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"
Jul 23 18:43:45.437358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.437212    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" event={"ID":"f4e10026-db22-4b0d-b57e-e623ae1ab2a9","Type":"ContainerDied","Data":"c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9"}
Jul 23 18:43:45.437358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.437278    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd" event={"ID":"f4e10026-db22-4b0d-b57e-e623ae1ab2a9","Type":"ContainerDied","Data":"48735241c7d3467124be8b5a18f72d680cd2bcfb88aa0bf53fa0d9ae94371598"}
Jul 23 18:43:45.437358 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.437308    2572 scope.go:117] "RemoveContainer" containerID="c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9"
Jul 23 18:43:45.447048 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.447028    2572 scope.go:117] "RemoveContainer" containerID="3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f"
Jul 23 18:43:45.455422 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.455406    2572 scope.go:117] "RemoveContainer" containerID="c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9"
Jul 23 18:43:45.455666 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:43:45.455648    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9\": container with ID starting with c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9 not found: ID does not exist" containerID="c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9"
Jul 23 18:43:45.455704 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.455675    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9"} err="failed to get container status \"c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9\": rpc error: code = NotFound desc = could not find container \"c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9\": container with ID starting with c98f61a55405c5b7e17b5c0ee9ba46b7c9485e60372ca5022ea66188c97df1a9 not found: ID does not exist"
Jul 23 18:43:45.455704 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.455694    2572 scope.go:117] "RemoveContainer" containerID="3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f"
Jul 23 18:43:45.455931 ip-10-0-129-70 kubenswrapper[2572]: E0723 18:43:45.455915    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f\": container with ID starting with 3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f not found: ID does not exist" containerID="3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f"
Jul 23 18:43:45.455967 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.455939    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f"} err="failed to get container status \"3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f\": rpc error: code = NotFound desc = could not find container \"3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f\": container with ID starting with 3dbab3ab1a53166f0e155f6c646a774ccd8dd4bf1ee873461574e86d66a44d1f not found: ID does not exist"
Jul 23 18:43:45.463961 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.463743    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"]
Jul 23 18:43:45.468232 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:45.468211    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f5044c-openshift-default-7749dbf567-wzqzd"]
Jul 23 18:43:46.359087 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:46.359045    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9x584_fdfa4145-d2ab-4b01-afbe-73dcb95cff70/manager/0.log"
Jul 23 18:43:46.490870 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:46.490838    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s2qqn_7092cf85-0a32-4bb4-b441-a60885bc92d4/manager/0.log"
Jul 23 18:43:46.747097 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:46.747010    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hw74s_4efbd195-b8f5-4a3e-a0d9-07542fd97b18/server/0.log"
Jul 23 18:43:46.792271 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:46.792239    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" path="/var/lib/kubelet/pods/f4e10026-db22-4b0d-b57e-e623ae1ab2a9/volumes"
Jul 23 18:43:46.876125 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:46.876086    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lnggn_d7c5315f-fe3d-47f9-ac74-2f966e1a8221/manager/0.log"
Jul 23 18:43:47.145340 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:47.145308    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f47b6774-b6ggj_196057d1-9117-4f15-959e-cf9946f8965b/copy-manifests/0.log"
Jul 23 18:43:47.153132 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:47.153106    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f47b6774-b6ggj_196057d1-9117-4f15-959e-cf9946f8965b/manager/0.log"
Jul 23 18:43:47.765882 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:47.765853    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747175-4xdmk_6f4fcc84-8998-468e-8bdd-cda3d30cf57a/cleanup/0.log"
Jul 23 18:43:47.887263 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:47.887233    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747190-bz2lf_ca056b9c-ffd6-4b87-9705-ab1055108966/cleanup/0.log"
Jul 23 18:43:48.862424 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:48.862393    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s_02eeafca-9104-4da9-949d-32b27607df69/extract/0.log"
Jul 23 18:43:48.869433 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:48.869413    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s_02eeafca-9104-4da9-949d-32b27607df69/util/0.log"
Jul 23 18:43:48.875692 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:48.875675    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s_02eeafca-9104-4da9-949d-32b27607df69/pull/0.log"
Jul 23 18:43:48.996498 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:48.996473    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5_9617f51f-c205-44f5-917a-18b9c9892274/util/0.log"
Jul 23 18:43:49.003346 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.003326    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5_9617f51f-c205-44f5-917a-18b9c9892274/pull/0.log"
Jul 23 18:43:49.009999 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.009978    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5_9617f51f-c205-44f5-917a-18b9c9892274/extract/0.log"
Jul 23 18:43:49.130200 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.130104    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4_36469446-5487-400d-8b15-1008c0e8e63b/util/0.log"
Jul 23 18:43:49.136893 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.136868    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4_36469446-5487-400d-8b15-1008c0e8e63b/pull/0.log"
Jul 23 18:43:49.143588 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.143565    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4_36469446-5487-400d-8b15-1008c0e8e63b/extract/0.log"
Jul 23 18:43:49.267373 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.267349    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8_e9d93db6-c396-43fa-b155-5ace5f39e57e/util/0.log"
Jul 23 18:43:49.274326 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.274306    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8_e9d93db6-c396-43fa-b155-5ace5f39e57e/pull/0.log"
Jul 23 18:43:49.281795 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.281773    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8_e9d93db6-c396-43fa-b155-5ace5f39e57e/extract/0.log"
Jul 23 18:43:49.555001 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.554974    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pk77g_e677afc8-dba4-4c66-9522-8765d61b1878/manager/0.log"
Jul 23 18:43:49.675304 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.675269    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hwtdx_75db02e5-9787-4302-8a4e-28548007f066/manager/0.log"
Jul 23 18:43:49.919647 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:49.919573    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ktvqw_21c46fda-8c06-454a-9b08-e57f7d728554/registry-server/0.log"
Jul 23 18:43:50.049250 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:50.049219    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8cgfg_de447859-a4a0-4a6f-9e1a-e7d504d51897/manager/0.log"
Jul 23 18:43:50.292214 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:50.292184    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-svzbv_c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb/manager/0.log"
Jul 23 18:43:50.662104 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:50.662020    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mg8rx_0b56ec11-5be8-4469-b017-af0a2c618009/istio-proxy/0.log"
Jul 23 18:43:51.020673 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:51.020651    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdff8959d-sprmh_b2259831-d1f6-4a85-989d-5470a163a0ca/kube-auth-proxy/0.log"
Jul 23 18:43:51.149730 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:51.149697    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zv9kz_3116235e-a0d6-433d-9fd7-946f894ae721/istio-proxy/1.log"
Jul 23 18:43:51.864582 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:51.864548    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gf9j5_4e456c12-81e3-44b9-9397-931dddb354ed/main/0.log"
Jul 23 18:43:52.099292 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:52.099260    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ffx4z_10448400-5d3a-49c8-9ff1-ebd49675b032/main/0.log"
Jul 23 18:43:58.775890 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.775863    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2mgnx/must-gather-nstbk"]
Jul 23 18:43:58.776249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776193    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy"
Jul 23 18:43:58.776249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776205    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy"
Jul 23 18:43:58.776249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776217    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7" containerName="revoke-keys"
Jul 23 18:43:58.776249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776222    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7" containerName="revoke-keys"
Jul 23 18:43:58.776249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776231    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy"
Jul 23 18:43:58.776249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776236    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy"
Jul 23 18:43:58.776249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776246    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy"
Jul 23 18:43:58.776249 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776251    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy"
Jul 23 18:43:58.776482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776260    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy"
Jul 23 18:43:58.776482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776265    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy"
Jul 23 18:43:58.776482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776313    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy"
Jul 23 18:43:58.776482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776323    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8293a092-ad7e-4c0c-8a99-5a5ad0f4c2b7" containerName="revoke-keys"
Jul 23 18:43:58.776482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776329    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy"
Jul 23 18:43:58.776482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776335    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef94e76d-f0ad-4231-9f76-11eba0c3d47d" containerName="istio-proxy"
Jul 23 18:43:58.776482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.776425    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4e10026-db22-4b0d-b57e-e623ae1ab2a9" containerName="istio-proxy"
Jul 23 18:43:58.785687 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.785662    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mgnx/must-gather-nstbk"
Jul 23 18:43:58.788736 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.788708    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mgnx\"/\"openshift-service-ca.crt\""
Jul 23 18:43:58.789324 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.789299    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mgnx\"/\"kube-root-ca.crt\""
Jul 23 18:43:58.789919 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.789897    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2mgnx\"/\"default-dockercfg-vpwh6\""
Jul 23 18:43:58.795376 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.795355    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mgnx/must-gather-nstbk"]
Jul 23 18:43:58.869007 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.868962    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-778jt\" (UniqueName: \"kubernetes.io/projected/3e552223-dbf0-4339-9c1b-ba85ad24495d-kube-api-access-778jt\") pod \"must-gather-nstbk\" (UID: \"3e552223-dbf0-4339-9c1b-ba85ad24495d\") " pod="openshift-must-gather-2mgnx/must-gather-nstbk"
Jul 23 18:43:58.869145 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.869016    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3e552223-dbf0-4339-9c1b-ba85ad24495d-must-gather-output\") pod \"must-gather-nstbk\" (UID: \"3e552223-dbf0-4339-9c1b-ba85ad24495d\") " pod="openshift-must-gather-2mgnx/must-gather-nstbk"
Jul 23 18:43:58.969404 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.969378    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-778jt\" (UniqueName: \"kubernetes.io/projected/3e552223-dbf0-4339-9c1b-ba85ad24495d-kube-api-access-778jt\") pod \"must-gather-nstbk\" (UID: \"3e552223-dbf0-4339-9c1b-ba85ad24495d\") " pod="openshift-must-gather-2mgnx/must-gather-nstbk"
Jul 23 18:43:58.969522 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.969428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3e552223-dbf0-4339-9c1b-ba85ad24495d-must-gather-output\") pod \"must-gather-nstbk\" (UID: \"3e552223-dbf0-4339-9c1b-ba85ad24495d\") " pod="openshift-must-gather-2mgnx/must-gather-nstbk"
Jul 23 18:43:58.969734 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.969719    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3e552223-dbf0-4339-9c1b-ba85ad24495d-must-gather-output\") pod \"must-gather-nstbk\" (UID: \"3e552223-dbf0-4339-9c1b-ba85ad24495d\") " pod="openshift-must-gather-2mgnx/must-gather-nstbk"
Jul 23 18:43:58.978318 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:58.978295    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-778jt\" (UniqueName: \"kubernetes.io/projected/3e552223-dbf0-4339-9c1b-ba85ad24495d-kube-api-access-778jt\") pod \"must-gather-nstbk\" (UID: \"3e552223-dbf0-4339-9c1b-ba85ad24495d\") " pod="openshift-must-gather-2mgnx/must-gather-nstbk"
Jul 23 18:43:59.096111 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:59.096039    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mgnx/must-gather-nstbk"
Jul 23 18:43:59.228545 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:43:59.228516    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e552223_dbf0_4339_9c1b_ba85ad24495d.slice/crio-d7628d316cf36900a5b7da50aa139a4042ac5a69d4fd1c8348f7f1f0bacd6e94 WatchSource:0}: Error finding container d7628d316cf36900a5b7da50aa139a4042ac5a69d4fd1c8348f7f1f0bacd6e94: Status 404 returned error can't find the container with id d7628d316cf36900a5b7da50aa139a4042ac5a69d4fd1c8348f7f1f0bacd6e94
Jul 23 18:43:59.228645 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:59.228559    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mgnx/must-gather-nstbk"]
Jul 23 18:43:59.513676 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:43:59.513644    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mgnx/must-gather-nstbk" event={"ID":"3e552223-dbf0-4339-9c1b-ba85ad24495d","Type":"ContainerStarted","Data":"d7628d316cf36900a5b7da50aa139a4042ac5a69d4fd1c8348f7f1f0bacd6e94"}
Jul 23 18:44:00.521023 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:00.520994    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mgnx/must-gather-nstbk" event={"ID":"3e552223-dbf0-4339-9c1b-ba85ad24495d","Type":"ContainerStarted","Data":"3b357febc6ee941a0cdc78c31eeb8f7830bae28d680ce13a7b700ce9f55df39f"}
Jul 23 18:44:01.531339 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:01.531255    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mgnx/must-gather-nstbk" event={"ID":"3e552223-dbf0-4339-9c1b-ba85ad24495d","Type":"ContainerStarted","Data":"46939ebf60435ab59e5d3e27b93ea64dc1ce322e7018c82f3db5fc18dfd6174c"}
Jul 23 18:44:01.557482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:01.557418    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2mgnx/must-gather-nstbk" podStartSLOduration=2.355959206 podStartE2EDuration="3.557395073s" totalImagesPullingTime="1.201435867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:01.555639578 +0000 UTC m=+2783.388330736" watchObservedRunningTime="2026-07-23 18:44:01.557395073 +0000 UTC m=+2783.390086232"
Jul 23 18:44:02.264303 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:02.264275    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mcqzn_22283f03-b1b4-4866-91bd-f1542d68df2b/global-pull-secret-syncer/0.log"
Jul 23 18:44:02.497915 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:02.497883    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gxdbb_6004c343-fd6c-4f9d-af11-f014ad66a2d4/konnectivity-agent/0.log"
Jul 23 18:44:02.539154 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:02.539068    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-70.ec2.internal_be78cfb9e61c5f94e698648d53053e99/haproxy/0.log"
Jul 23 18:44:06.632709 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.632679    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s_02eeafca-9104-4da9-949d-32b27607df69/extract/0.log"
Jul 23 18:44:06.657018 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.656970    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s_02eeafca-9104-4da9-949d-32b27607df69/util/0.log"
Jul 23 18:44:06.685549 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.685518    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctw8s_02eeafca-9104-4da9-949d-32b27607df69/pull/0.log"
Jul 23 18:44:06.717329 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.717229    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5_9617f51f-c205-44f5-917a-18b9c9892274/extract/0.log"
Jul 23 18:44:06.754820 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.754686    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5_9617f51f-c205-44f5-917a-18b9c9892274/util/0.log"
Jul 23 18:44:06.781192 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.781161    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08qrb5_9617f51f-c205-44f5-917a-18b9c9892274/pull/0.log"
Jul 23 18:44:06.821318 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.821287    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4_36469446-5487-400d-8b15-1008c0e8e63b/extract/0.log"
Jul 23 18:44:06.845998 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.845967    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4_36469446-5487-400d-8b15-1008c0e8e63b/util/0.log"
Jul 23 18:44:06.876516 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.876467    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqn4_36469446-5487-400d-8b15-1008c0e8e63b/pull/0.log"
Jul 23 18:44:06.907793 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.907707    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8_e9d93db6-c396-43fa-b155-5ace5f39e57e/extract/0.log"
Jul 23 18:44:06.934296 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.934261    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8_e9d93db6-c396-43fa-b155-5ace5f39e57e/util/0.log"
Jul 23 18:44:06.958385 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:06.958350    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rjlc8_e9d93db6-c396-43fa-b155-5ace5f39e57e/pull/0.log"
Jul 23 18:44:07.636067 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:07.636033    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pk77g_e677afc8-dba4-4c66-9522-8765d61b1878/manager/0.log"
Jul 23 18:44:07.673231 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:07.673196    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hwtdx_75db02e5-9787-4302-8a4e-28548007f066/manager/0.log"
Jul 23 18:44:07.795196 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:07.795159    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ktvqw_21c46fda-8c06-454a-9b08-e57f7d728554/registry-server/0.log"
Jul 23 18:44:08.026434 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:08.026400    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8cgfg_de447859-a4a0-4a6f-9e1a-e7d504d51897/manager/0.log"
Jul 23 18:44:08.145771 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:08.143850    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-svzbv_c10deea0-2b8a-49ed-b8ab-06ae5f0be6fb/manager/0.log"
Jul 23 18:44:10.051236 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:10.051205    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-s479d_d43c0b9e-9e41-44ea-adc1-342ba12f3ef8/cluster-monitoring-operator/0.log"
Jul 23 18:44:10.415388 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:10.415274    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r7nsq_3bfcaf42-b00d-416d-ae6f-12523d7033da/node-exporter/0.log"
Jul 23 18:44:10.441546 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:10.441501    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r7nsq_3bfcaf42-b00d-416d-ae6f-12523d7033da/kube-rbac-proxy/0.log"
Jul 23 18:44:10.468772 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:10.468732    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r7nsq_3bfcaf42-b00d-416d-ae6f-12523d7033da/init-textfile/0.log"
Jul 23 18:44:10.783096 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:10.783059    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ft28k_43ebd81f-5c0c-4517-b0a0-f27f9a3a6876/prometheus-operator/0.log"
Jul 23 18:44:10.809844 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:10.809814    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ft28k_43ebd81f-5c0c-4517-b0a0-f27f9a3a6876/kube-rbac-proxy/0.log"
Jul 23 18:44:11.774262 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:11.771394    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"]
Jul 23 18:44:11.783981 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:11.777805    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"]
Jul 23 18:44:11.783981 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:11.777933    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:11.904380 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:11.904339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-lib-modules\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:11.904597 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:11.904478    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snr2h\" (UniqueName: \"kubernetes.io/projected/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-kube-api-access-snr2h\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:11.904597 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:11.904528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-proc\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:11.904726 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:11.904626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-podres\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:11.904726 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:11.904652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-sys\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005399    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-podres\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-sys\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005538    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-lib-modules\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snr2h\" (UniqueName: \"kubernetes.io/projected/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-kube-api-access-snr2h\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-proc\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005738    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-proc\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005799    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-sys\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005848    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-podres\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.005878 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.005859    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-lib-modules\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.017605 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.017568    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snr2h\" (UniqueName: \"kubernetes.io/projected/f06faa8f-e28f-4c6a-b2e1-56d5c57f9765-kube-api-access-snr2h\") pod \"perf-node-gather-daemonset-8g5bf\" (UID: \"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765\") " pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.093824 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.093717    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.271080 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.271019    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"]
Jul 23 18:44:12.276292 ip-10-0-129-70 kubenswrapper[2572]: W0723 18:44:12.276253    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf06faa8f_e28f_4c6a_b2e1_56d5c57f9765.slice/crio-7e67a78810094fcfcfacabcf5ffd6b8a87ff1644a1ad4afc8a54e0a0ea703c28 WatchSource:0}: Error finding container 7e67a78810094fcfcfacabcf5ffd6b8a87ff1644a1ad4afc8a54e0a0ea703c28: Status 404 returned error can't find the container with id 7e67a78810094fcfcfacabcf5ffd6b8a87ff1644a1ad4afc8a54e0a0ea703c28
Jul 23 18:44:12.621528 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.621427    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf" event={"ID":"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765","Type":"ContainerStarted","Data":"142f6c656887b2a2ec17d8d031c98bc7508d91d4fa16d9d12d0327de74822216"}
Jul 23 18:44:12.621528 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.621505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf" event={"ID":"f06faa8f-e28f-4c6a-b2e1-56d5c57f9765","Type":"ContainerStarted","Data":"7e67a78810094fcfcfacabcf5ffd6b8a87ff1644a1ad4afc8a54e0a0ea703c28"}
Jul 23 18:44:12.622335 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.622306    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:12.643977 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:12.643912    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf" podStartSLOduration=1.643888429 podStartE2EDuration="1.643888429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:12.641581933 +0000 UTC m=+2794.474273111" watchObservedRunningTime="2026-07-23 18:44:12.643888429 +0000 UTC m=+2794.476579584"
Jul 23 18:44:15.274426 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:15.274401    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98bl8_e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c/dns/0.log"
Jul 23 18:44:15.298124 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:15.298097    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-98bl8_e4d0cd5f-00b4-4fa7-b78f-e09deca27e1c/kube-rbac-proxy/0.log"
Jul 23 18:44:15.382557 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:15.382523    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wqhlk_abc29980-1bd1-463b-8fe7-3a6be20750c8/dns-node-resolver/0.log"
Jul 23 18:44:16.012791 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:16.012735    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bqk5j_b3948691-c50e-4038-bede-73ef860778db/node-ca/0.log"
Jul 23 18:44:17.089578 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:17.089544    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mg8rx_0b56ec11-5be8-4469-b017-af0a2c618009/istio-proxy/0.log"
Jul 23 18:44:17.278733 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:17.278702    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdff8959d-sprmh_b2259831-d1f6-4a85-989d-5470a163a0ca/kube-auth-proxy/0.log"
Jul 23 18:44:17.316568 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:17.316539    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zv9kz_3116235e-a0d6-433d-9fd7-946f894ae721/istio-proxy/0.log"
Jul 23 18:44:17.363672 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:17.363601    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zv9kz_3116235e-a0d6-433d-9fd7-946f894ae721/istio-proxy/1.log"
Jul 23 18:44:18.207294 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:18.207259    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8856l_f56ac216-1379-4af2-a1df-b4b7955ef602/serve-healthcheck-canary/0.log"
Jul 23 18:44:18.804951 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:18.804899    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-j8wfq_9d8a3ee6-8122-4e53-b466-41d3775ec235/insights-operator/0.log"
Jul 23 18:44:18.806652 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:18.806620    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-j8wfq_9d8a3ee6-8122-4e53-b466-41d3775ec235/insights-operator/1.log"
Jul 23 18:44:18.979042 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:18.979017    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nfps8_4faaf47a-401c-4b15-b098-077b2dc474ab/kube-rbac-proxy/0.log"
Jul 23 18:44:19.002674 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:19.002644    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nfps8_4faaf47a-401c-4b15-b098-077b2dc474ab/exporter/0.log"
Jul 23 18:44:19.029661 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:19.029608    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nfps8_4faaf47a-401c-4b15-b098-077b2dc474ab/extractor/0.log"
Jul 23 18:44:19.648482 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:19.648454    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2mgnx/perf-node-gather-daemonset-8g5bf"
Jul 23 18:44:21.536608 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:21.536521    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9x584_fdfa4145-d2ab-4b01-afbe-73dcb95cff70/manager/0.log"
Jul 23 18:44:21.887790 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:21.886638    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s2qqn_7092cf85-0a32-4bb4-b441-a60885bc92d4/manager/0.log"
Jul 23 18:44:22.040182 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:22.040151    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hw74s_4efbd195-b8f5-4a3e-a0d9-07542fd97b18/server/0.log"
Jul 23 18:44:22.161038 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:22.160999    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lnggn_d7c5315f-fe3d-47f9-ac74-2f966e1a8221/manager/0.log"
Jul 23 18:44:22.295630 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:22.295551    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f47b6774-b6ggj_196057d1-9117-4f15-959e-cf9946f8965b/manager/0.log"
Jul 23 18:44:22.320020 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:22.319992    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9f47b6774-b6ggj_196057d1-9117-4f15-959e-cf9946f8965b/copy-manifests/0.log"
Jul 23 18:44:22.535825 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:22.535793    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mg8rx_0b56ec11-5be8-4469-b017-af0a2c618009/istio-proxy/0.log"
Jul 23 18:44:22.704406 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:22.704324    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdff8959d-sprmh_b2259831-d1f6-4a85-989d-5470a163a0ca/kube-auth-proxy/0.log"
Jul 23 18:44:22.736500 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:22.736475    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zv9kz_3116235e-a0d6-433d-9fd7-946f894ae721/istio-proxy/0.log"
Jul 23 18:44:22.789147 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:22.789106    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zv9kz_3116235e-a0d6-433d-9fd7-946f894ae721/istio-proxy/1.log"
Jul 23 18:44:23.954856 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:23.954816    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bfp47_89616a86-e047-4e82-a611-fa853f3e5865/openshift-lws-operator/0.log"
Jul 23 18:44:24.146781 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:24.146691    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mg8rx_0b56ec11-5be8-4469-b017-af0a2c618009/istio-proxy/0.log"
Jul 23 18:44:24.299112 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:24.299084    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cdff8959d-sprmh_b2259831-d1f6-4a85-989d-5470a163a0ca/kube-auth-proxy/0.log"
Jul 23 18:44:24.323693 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:24.323666    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zv9kz_3116235e-a0d6-433d-9fd7-946f894ae721/istio-proxy/0.log"
Jul 23 18:44:24.365198 ip-10-0-129-70 kubenswrapper[2572]: I0723 18:44:24.365168    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zv9kz_3116235e-a0d6-433d-9fd7-946f894ae721/istio-proxy/1.log"