Jul 28 19:46:48.498545 ip-10-0-128-236 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 19:46:48.961623 ip-10-0-128-236 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:46:48.961623 ip-10-0-128-236 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 19:46:48.961623 ip-10-0-128-236 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:46:48.961623 ip-10-0-128-236 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 19:46:48.961623 ip-10-0-128-236 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:46:48.962675 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.962500    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 19:46:48.970788 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970770    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:46:48.970788 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970787    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970791    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970794    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970797    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970800    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970802    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970805    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970808    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970810    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970813    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970821    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970824    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970828    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970830    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970833    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970836    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970838    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970840    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970845    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:46:48.970864 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970848    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970852    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970854    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970857    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970861    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970866    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970869    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970873    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970876    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970879    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970882    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970885    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970887    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970890    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970892    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970895    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970897    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970900    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970902    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970904    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:46:48.971343 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970907    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970910    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970912    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970915    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970918    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970920    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970923    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970926    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970928    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970931    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970933    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970936    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970939    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970942    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970944    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970947    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970949    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970952    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970954    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:46:48.971870 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970956    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970959    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970962    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970964    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970967    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970969    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970972    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970974    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970977    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970979    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970984    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970987    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970990    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970993    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970996    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.970999    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971001    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971003    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971006    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971009    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:46:48.972373 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971012    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971014    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971017    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971019    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971022    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971024    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971027    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971030    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971033    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971036    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971041    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971044    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971046    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971049    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971052    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971055    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971057    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971060    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971062    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971064    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:46:48.972852 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971801    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971808    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971811    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971814    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971816    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971820    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971822    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971825    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971827    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971830    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971832    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971837    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971839    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971842    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971845    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971847    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971850    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971853    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971856    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971859    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:46:48.973358 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971861    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971864    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971867    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971869    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971872    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971875    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971878    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971880    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971883    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971885    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971888    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971891    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971893    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971896    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971898    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971901    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971904    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971907    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971909    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971912    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:46:48.973896 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971914    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971917    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971919    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971922    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971925    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971928    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971930    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971933    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971935    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971938    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971941    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971944    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971947    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971949    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971952    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971954    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971958    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971962    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971965    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:46:48.974411 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971968    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971971    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971974    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971976    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971979    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971981    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971983    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971986    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971988    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971991    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971994    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.971996    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972000    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972003    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972006    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972008    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972011    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972015    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972018    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972020    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:46:48.974909 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972022    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972025    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972027    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972029    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972033    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972035    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972039    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972043    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972046    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972049    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972052    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972054    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972056    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972059    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972062    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972064    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972067    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972069    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972071    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:46:48.975540 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972074    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972494    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972501    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972504    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972507    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972509    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972513    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972516    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972519    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972522    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972524    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972528    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972530    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972534    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972537    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972539    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972542    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972544    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972547    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972550    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:46:48.976000 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972552    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972554    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972557    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972560    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972563    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972565    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972568    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972570    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972573    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972575    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972578    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972580    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972583    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972587    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972590    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972593    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972595    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972598    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972600    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:46:48.976524 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972603    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972605    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972607    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972610    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972612    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972615    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972619    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972622    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972624    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972627    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972630    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972632    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972635    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972637    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972639    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972642    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972644    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972647    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972649    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972651    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:46:48.976984 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972654    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972657    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972661    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972664    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972667    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972669    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972673    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972676    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972678    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972680    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972683    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972685    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972688    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972690    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972693    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972695    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972697    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972700    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972703    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972705    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:46:48.977489 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972708    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972710    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972713    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972715    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972717    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972720    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972723    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972725    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972727    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972730    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972732    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972734    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972737    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972739    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972741    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972744    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972746    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972748    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972752    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:46:48.977986 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972755    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.972758    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972834    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972851    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972861    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972868    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972873    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972876    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972880    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972887    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972890    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972894    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972898    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972901    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972905    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972908    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972911    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972913    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972916    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972919    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972923    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972925    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972929    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 19:46:48.978463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972931    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972934    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972938    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972941    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972944    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972947    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972950    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972953    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972959    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972962    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972965    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972970    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972973    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972975    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972978    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972981    2575 flags.go:64] FLAG: --enable-server="true"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972984    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972988    2575 flags.go:64] FLAG: --event-burst="100"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972991    2575 flags.go:64] FLAG: --event-qps="50"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972994    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.972998    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973001    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973006    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973009    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973012    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 19:46:48.979003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973015    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973017    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973020    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973023    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973026    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973028    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973031    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973033    2575 flags.go:64] FLAG: --feature-gates=""
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973037    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973040    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973043    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973046    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973049    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973052    2575 flags.go:64] FLAG: --help="false"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973055    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-128-236.ec2.internal"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973060    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973062    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973065    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973068    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973071    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973074    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973077    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973080    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 19:46:48.979668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973083    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973085    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973088    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973091    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973095    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973098    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973101    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973110    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973113    2575 flags.go:64] FLAG: --lock-file=""
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973116    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973119    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973122    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973131    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973134    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973137    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973140    2575 flags.go:64] FLAG: --logging-format="text"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973143    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973146    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973149    2575 flags.go:64] FLAG: --manifest-url=""
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973152    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973156    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973159    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973176    2575 flags.go:64] FLAG: --max-pods="110"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973180    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973184    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 19:46:48.980586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973187    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973190    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973193    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973196    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973199    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973206    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973210    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973213    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973216    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973218    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973224    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973227    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973231    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973234    2575 flags.go:64] FLAG: --port="10250"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973237    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973241    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-066ff726c75aeb981"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973244    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973247    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973250    2575 flags.go:64] FLAG: --register-node="true"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973253    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973256    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973259    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973262    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973265    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973268    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 19:46:48.981607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973271    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973274    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973277    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973280    2575 flags.go:64] FLAG: --runonce="false"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973283    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973285    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973289    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973292    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973295    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973298    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973301    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973304    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973307    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973310    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973312    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973315    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973318    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973321    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973323    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973330    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973332    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973335    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973338    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973341    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973344    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 19:46:48.982406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973347    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973350    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973353    2575 flags.go:64] FLAG: --v="2"
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973357    2575 flags.go:64] FLAG: --version="false"
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973361    2575 flags.go:64] FLAG: --vmodule=""
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973365    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.973368    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973504    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973508    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973512    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973515    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973518    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973520    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973523    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973526    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973528    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973531    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973534    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973536    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973538    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973541    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973544    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:46:48.983044 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973546    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973548    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973551    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973553    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973558    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973560    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973563    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973565    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973568    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973571    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973574    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973576    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973579    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973581    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973583    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973586    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973588    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973591    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973593    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973596    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:46:48.983607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973598    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973601    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973603    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973606    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973608    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973611    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973613    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973616    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973618    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973621    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973623    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973625    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973628    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973630    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973633    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973636    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973639    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973642    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973644    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:46:48.984105 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973647    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973651    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973654    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973657    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973660    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973664    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973669    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973672    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973674    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973677    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973680    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973682    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973684    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973687    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973689    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973692    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973694    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973697    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973699    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:46:48.984722 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973701    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973704    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973707    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973709    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973712    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973714    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973716    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973719    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973721    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973723    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973727    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973730    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973732    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973735    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973737    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973740    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973742    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973745    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973748    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:46:48.985222 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973751    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973754    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973757    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973761    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973764    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973766    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.973769    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.974451    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.983178    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.983195    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.983210    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.983216    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983273    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983279    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:46:48.985688 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983282    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983285    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983288    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983290    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983293    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983296    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983299    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983301    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983304    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983306    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983309    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983312    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983314    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983317    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983320    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983322    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983325    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983328    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983330    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983337    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:46:48.986043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983340    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983342    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983345    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983347    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983350    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983352    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983355    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983357    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983360    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983363    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983365    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983368    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983370    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983373    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983375    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983378    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983380    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983383    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983385    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983388    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:46:48.986622 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983390    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983393    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983395    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983398    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983401    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983404    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983407    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983409    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983414    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983417    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983420    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983423    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983426    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983429    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983432    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983435    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983437    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983440    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983443    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:46:48.987116 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983445    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983448    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983450    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983453    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983456    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983458    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983461    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983464    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983466    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983469    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983471    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983474    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983476    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983479    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983481    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983484    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983488    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983491    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983495    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983499    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:46:48.987611 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983502    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983505    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983507    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983509    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983512    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983514    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983517    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983520    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983524    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983527    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983529    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983532    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983535    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983537    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983540    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983542    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983545    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:46:48.988102 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983547    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.983553    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983669    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983675    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983678    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983681    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983685    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983687    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983691    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983695    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983698    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983701    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983704    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983707    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983711    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:46:48.988563 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983714    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983717    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983719    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983722    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983724    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983727    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983729    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983731    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983734    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983736    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983739    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983741    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983744    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983746    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983749    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983751    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983753    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983756    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983758    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983760    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:46:48.988944 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983763    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983765    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983768    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983770    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983773    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983775    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983777    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983781    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983785    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983787    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983790    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983792    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983795    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983798    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983800    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983802    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983805    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983807    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983809    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:46:48.989537 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983812    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983815    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983817    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983820    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983822    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983824    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983827    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983829    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983831    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983834    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983836    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983839    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983841    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983843    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983846    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983848    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983851    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983853    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983855    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983858    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:46:48.990014 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983860    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983862    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983865    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983867    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983870    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983872    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983876    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983879    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983881    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983884    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983888    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983891    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983894    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983897    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983900    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983903    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983905    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983908    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983911    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:46:48.990555 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983913    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983915    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983918    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983920    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983923    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983925    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983927    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:48.983930    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.983935    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.984047    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.986253    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.987572    2575 server.go:1019] "Starting client certificate rotation"
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.987676    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 19:46:48.991041 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.987707    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 19:46:48.991392 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.990914    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 19:46:48.993879 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:48.993862    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 19:46:49.010735 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.010712    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 28 19:46:49.012808 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.012793    2575 log.go:25] "Validated CRI v1 image API"
Jul 28 19:46:49.013600 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.013586    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 19:46:49.016251 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.016230    2575 fs.go:135] Filesystem UUIDs: map[24532c66-6411-4e26-a320-c62ad81da601:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 84434e9d-51c3-41b7-954e-e67975899bb6:/dev/nvme0n1p4]
Jul 28 19:46:49.016345 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.016250    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 19:46:49.016552 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.016534    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 19:46:49.022805 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.022695    2575 manager.go:216] Machine: {Timestamp:2026-07-28 19:46:49.021240875 +0000 UTC m=+0.390377978 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102214 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23dda25faf881eb4c907a0ef0c6f01 SystemUUID:ec23dda2-5faf-881e-b4c9-07a0ef0c6f01 BootID:93d31662-0c86-448f-b8ec-821b525d155d Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:66:77:4a:3a:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:66:77:4a:3a:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:7d:41:b5:8c:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 19:46:49.022805 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.022798    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 19:46:49.022934 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.022884    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 19:46:49.026499 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.026472    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 19:46:49.026636 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.026501    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 19:46:49.027371 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.027361    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 19:46:49.027404 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.027374    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 19:46:49.027404 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.027381    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 19:46:49.027404 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.027395    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 19:46:49.028825 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.028814    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 19:46:49.032346 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032335    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 19:46:49.032465 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032455    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 19:46:49.032498 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032489    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 19:46:49.032529 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032503    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 19:46:49.032529 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032522    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 19:46:49.032585 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032535    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 28 19:46:49.032585 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032547    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 19:46:49.032985 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032973    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 19:46:49.033033 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.032993    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 19:46:49.035236 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.035216    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 19:46:49.036684 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.036671    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 19:46:49.036733 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.036702    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 19:46:49.037446 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037430    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6ttk9"
Jul 28 19:46:49.037828 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037815    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 19:46:49.037876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037835    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 19:46:49.037876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037843    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 19:46:49.037876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037849    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 19:46:49.037876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037858    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 19:46:49.037876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037864    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 19:46:49.037876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037873    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 19:46:49.037876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037878    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 19:46:49.038059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037885    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 19:46:49.038059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037891    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 19:46:49.038059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037900    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 19:46:49.038059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.037905    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 19:46:49.039506 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.039495    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 19:46:49.039547 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.039507    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 19:46:49.042205 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.042185    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 19:46:49.042819 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.042796    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 19:46:49.042888 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.042794    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 19:46:49.043104 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.043091    2575 server.go:1268] "Started kubelet"
Jul 28 19:46:49.043205 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.043183    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 19:46:49.043272 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.043185    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 19:46:49.043272 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.043249    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 19:46:49.044060 ip-10-0-128-236 systemd[1]: Started Kubernetes Kubelet.
Jul 28 19:46:49.044684 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.044442    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6ttk9"
Jul 28 19:46:49.044969 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.044956    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 19:46:49.045111 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.045099    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 19:46:49.048788 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.048769    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 19:46:49.052115 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.051152    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-236.ec2.internal.18c68bcba3e174b3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-236.ec2.internal,UID:ip-10-0-128-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-236.ec2.internal,},FirstTimestamp:2026-07-28 19:46:49.043063987 +0000 UTC m=+0.412201088,LastTimestamp:2026-07-28 19:46:49.043063987 +0000 UTC m=+0.412201088,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-236.ec2.internal,}"
Jul 28 19:46:49.053075 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.053056    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 19:46:49.053075 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.053065    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 19:46:49.053275 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.053240    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.053746 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.053724    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 19:46:49.053746 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.053745    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 19:46:49.053876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.053726    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 19:46:49.053876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.053859    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 19:46:49.053876 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.053868    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 19:46:49.054196 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.054160    2575 factory.go:153] Registering CRI-O factory
Jul 28 19:46:49.054267 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.054199    2575 factory.go:223] Registration of the crio container factory successfully
Jul 28 19:46:49.054267 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.054251    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 19:46:49.054267 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.054262    2575 factory.go:55] Registering systemd factory
Jul 28 19:46:49.054267 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.054269    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 28 19:46:49.054443 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.054290    2575 factory.go:103] Registering Raw factory
Jul 28 19:46:49.054443 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.054302    2575 manager.go:1196] Started watching for new ooms in manager
Jul 28 19:46:49.054816 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.054802    2575 manager.go:349] Starting recovery of all containers
Jul 28 19:46:49.058160 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.058143    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:46:49.061579 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.061558    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-236.ec2.internal\" not found" node="ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.064045 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.064012    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 19:46:49.068633 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.068477    2575 manager.go:354] Recovery completed
Jul 28 19:46:49.072638 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.072624    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:46:49.074431 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.074410    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:46:49.074502 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.074450    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:46:49.074502 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.074462    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:46:49.075084 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.075070    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 19:46:49.075084 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.075082    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 19:46:49.075194 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.075086    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:46:49.075194 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.075098    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 19:46:49.075798 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.075784    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:46:49.075847 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.075813    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:46:49.075847 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.075823    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:46:49.076605 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.076593    2575 policy_none.go:49] "None policy: Start"
Jul 28 19:46:49.076640 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.076610    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 19:46:49.076640 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.076621    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 19:46:49.077639 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.077628    2575 policy_none.go:47] "Start"
Jul 28 19:46:49.112771 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.112750    2575 manager.go:337] "Starting Device Plugin manager"
Jul 28 19:46:49.112906 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.112784    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 19:46:49.112906 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.112798    2575 server.go:87] "Starting device plugin registration server"
Jul 28 19:46:49.113078 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.113065    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 19:46:49.113112 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.113080    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 19:46:49.113194 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.113159    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 19:46:49.113270 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.113259    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 19:46:49.113316 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.113272    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 19:46:49.113845 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.113828    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 19:46:49.113937 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.113872    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.129317 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.129294    2575 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2614 into the system container \"/system.slice\": <nil>"
Jul 28 19:46:49.213463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.213380    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:46:49.215182 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.215123    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:46:49.215182 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.215185    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:46:49.215365 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.215199    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:46:49.215365 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.215226    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.223297 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.223267    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.223297 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.223294    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-236.ec2.internal\": node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.235820 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.235790    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.251704 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.251670    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 19:46:49.251822 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.251716    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 19:46:49.251822 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.251739    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 19:46:49.251822 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.251771    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 19:46:49.254123 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.254103    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:46:49.336479 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.336430    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.352625 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.352591    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal"]
Jul 28 19:46:49.352712 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.352677    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:46:49.354485 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.354468    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:46:49.354607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.354496    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:46:49.354607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.354506    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:46:49.355607 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.355590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6ee948d6d60e97c7c0c460ca0eb1e3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal\" (UID: \"e6ee948d6d60e97c7c0c460ca0eb1e3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.355674 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.355615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6ee948d6d60e97c7c0c460ca0eb1e3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal\" (UID: \"e6ee948d6d60e97c7c0c460ca0eb1e3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.355837 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.355826    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:46:49.355950 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.355937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.356005 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.355972    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:46:49.356641 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.356622    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:46:49.356755 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.356648    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:46:49.356755 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.356675    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:46:49.356956 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.356942    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:46:49.357010 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.356968    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:46:49.357010 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.356978    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:46:49.358115 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.358098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.358199 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.358132    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:46:49.361869 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.361849    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:46:49.361948 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.361885    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:46:49.361948 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.361900    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:46:49.374895 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.374866    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-236.ec2.internal\" not found" node="ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.380367 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.380346    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-236.ec2.internal\" not found" node="ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.437540 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.437499    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.456290 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.456258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6ee948d6d60e97c7c0c460ca0eb1e3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal\" (UID: \"e6ee948d6d60e97c7c0c460ca0eb1e3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.456290 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.456292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6ee948d6d60e97c7c0c460ca0eb1e3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal\" (UID: \"e6ee948d6d60e97c7c0c460ca0eb1e3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.456478 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.456313    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a426c9c0dc23284d58a8b55be14deec-config\") pod \"kube-apiserver-proxy-ip-10-0-128-236.ec2.internal\" (UID: \"0a426c9c0dc23284d58a8b55be14deec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.456478 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.456361    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6ee948d6d60e97c7c0c460ca0eb1e3e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal\" (UID: \"e6ee948d6d60e97c7c0c460ca0eb1e3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.456478 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.456378    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6ee948d6d60e97c7c0c460ca0eb1e3e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal\" (UID: \"e6ee948d6d60e97c7c0c460ca0eb1e3e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.537789 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.537707    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.557091 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.557056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a426c9c0dc23284d58a8b55be14deec-config\") pod \"kube-apiserver-proxy-ip-10-0-128-236.ec2.internal\" (UID: \"0a426c9c0dc23284d58a8b55be14deec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.557222 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.557128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a426c9c0dc23284d58a8b55be14deec-config\") pod \"kube-apiserver-proxy-ip-10-0-128-236.ec2.internal\" (UID: \"0a426c9c0dc23284d58a8b55be14deec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.638256 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.638213    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.676762 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.676729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.684246 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.684227    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:49.738698 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.738655    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.839298 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.839214    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.939788 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:49.939738    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:49.987515 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.987476    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 19:46:49.988144 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.987631    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 19:46:49.988144 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:49.987660    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 19:46:50.039881 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:50.039846    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:50.046422 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.046391    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:46:50.049872 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.049832    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 19:41:50 +0000 UTC" deadline="2028-02-21 06:54:54.027252546 +0000 UTC"
Jul 28 19:46:50.049932 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.049873    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13739h8m3.977382641s"
Jul 28 19:46:50.140780 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:50.140749    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:50.212585 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:50.212548    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ee948d6d60e97c7c0c460ca0eb1e3e.slice/crio-d850385b07ab62cac0ee785ad350142fcb575d597699662a90fc3bd6171fe8a9 WatchSource:0}: Error finding container d850385b07ab62cac0ee785ad350142fcb575d597699662a90fc3bd6171fe8a9: Status 404 returned error can't find the container with id d850385b07ab62cac0ee785ad350142fcb575d597699662a90fc3bd6171fe8a9
Jul 28 19:46:50.213282 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:50.213258    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a426c9c0dc23284d58a8b55be14deec.slice/crio-e5571178268700537cc1de3ec2eb2f6e489e5d847c74ca7e266bf58b8e30895e WatchSource:0}: Error finding container e5571178268700537cc1de3ec2eb2f6e489e5d847c74ca7e266bf58b8e30895e: Status 404 returned error can't find the container with id e5571178268700537cc1de3ec2eb2f6e489e5d847c74ca7e266bf58b8e30895e
Jul 28 19:46:50.219357 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.219339    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:46:50.241310 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:50.241269    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:50.255851 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.255789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal" event={"ID":"0a426c9c0dc23284d58a8b55be14deec","Type":"ContainerStarted","Data":"e5571178268700537cc1de3ec2eb2f6e489e5d847c74ca7e266bf58b8e30895e"}
Jul 28 19:46:50.256855 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.256833    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal" event={"ID":"e6ee948d6d60e97c7c0c460ca0eb1e3e","Type":"ContainerStarted","Data":"d850385b07ab62cac0ee785ad350142fcb575d597699662a90fc3bd6171fe8a9"}
Jul 28 19:46:50.344712 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:50.344658    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:50.449297 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:50.449203    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-236.ec2.internal\" not found"
Jul 28 19:46:50.452116 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.452097    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:46:50.453975 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.453955    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:50.464374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.464348    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 19:46:50.465797 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.465783    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal"
Jul 28 19:46:50.473973 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:50.473947    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 19:46:51.033603 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.033561    2575 apiserver.go:52] "Watching apiserver"
Jul 28 19:46:51.041419 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.041384    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 19:46:51.041836 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.041803    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ppn7s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal","openshift-multus/multus-additional-cni-plugins-2pdl7","openshift-multus/network-metrics-daemon-mn7vj","openshift-network-diagnostics/network-check-target-hjst7","kube-system/konnectivity-agent-qrhll","kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal","openshift-image-registry/node-ca-w64pz","openshift-multus/multus-cr6p8","openshift-network-operator/iptables-alerter-6ddjw","openshift-ovn-kubernetes/ovnkube-node-gw84m","kube-system/global-pull-secret-syncer-5fgtz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w","openshift-cluster-node-tuning-operator/tuned-fqtbx"]
Jul 28 19:46:51.043569 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.043546    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.045349 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.045324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.046009 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.045979    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ptpmw\""
Jul 28 19:46:51.046121 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.046103    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 19:46:51.046265 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.046245    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 19:46:51.046315 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.046272    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:46:51.046767 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.046749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.047976 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.047710    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 19:46:51.047976 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.047710    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 19:46:51.047976 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.047859    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bbjrs\""
Jul 28 19:46:51.047976 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.047886    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 19:46:51.048215 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.048196    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:51.048353 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.048329    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:46:51.048807 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.048790    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 19:46:51.049030 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.049010    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 19:46:51.049131 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.049102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 19:46:51.049936 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.049905    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 19:46:51.050041 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.049985    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 19:46:51.050593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.050573    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:51.050691 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.050656    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:46:51.050852 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.050827    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gtzzl\""
Jul 28 19:46:51.052149 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.052129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:46:51.054179 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.053692    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 19:46:51.054179 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.053733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.054645 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.054622    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dmqfh\""
Jul 28 19:46:51.054741 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.054702    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 19:46:51.054741 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.054731    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 19:46:51.056135 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.056114    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 19:46:51.056261 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.056120    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fjrsb\""
Jul 28 19:46:51.056512 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.056490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.058213 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.058194    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.058784 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.058764    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kj677\""
Jul 28 19:46:51.058871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.058796    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:46:51.058953 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.058938    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 19:46:51.059288 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.059269    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.061504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.060960    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.061504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.061019    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 19:46:51.061504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.061068    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 19:46:51.061504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.061310    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 19:46:51.061504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.061452    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8xhmz\""
Jul 28 19:46:51.061818 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.061779    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 19:46:51.062118 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.062096    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 19:46:51.062193 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.062102    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jh7gg\""
Jul 28 19:46:51.062563 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.062542    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.062648 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.062615    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:46:51.063329 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.063309    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 19:46:51.063576 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.063555    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 19:46:51.065434 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.065263    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 19:46:51.065636 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.065618    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 19:46:51.065682 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.065637    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 19:46:51.065837 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.065814    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n2qqq\""
Jul 28 19:46:51.066043 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.065816    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 19:46:51.066121 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-os-release\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.066121 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-modprobe-d\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.066232 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-kubernetes\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.066232 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-systemd\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.066232 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvn9t\" (UniqueName: \"kubernetes.io/projected/369dbc6a-5ebb-461b-aed5-3732b372d7d4-kube-api-access-gvn9t\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.066232 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f036892-882f-448d-9dec-b5e936bd831a-agent-certs\") pod \"konnectivity-agent-qrhll\" (UID: \"7f036892-882f-448d-9dec-b5e936bd831a\") " pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:46:51.066463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-hostroot\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.066463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-registration-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.066463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npqrc\" (UniqueName: \"kubernetes.io/projected/8e207cd5-c660-4cc1-be4d-ecd66c90d512-kube-api-access-npqrc\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.066463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/911be198-df59-4893-b47a-687731745194-multus-daemon-config\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.066463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.066463 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f036892-882f-448d-9dec-b5e936bd831a-konnectivity-ca\") pod \"konnectivity-agent-qrhll\" (UID: \"7f036892-882f-448d-9dec-b5e936bd831a\") " pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:46:51.066739 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066484    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-os-release\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.066739 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.066739 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-lib-modules\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.066739 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066648    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-multus-certs\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.066739 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-socket-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.066739 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-etc-selinux\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.066739 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4mn8\" (UniqueName: \"kubernetes.io/projected/5ff3f583-c2be-44ff-bd5a-3e2378643f28-kube-api-access-z4mn8\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-system-cni-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysctl-d\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-sys\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/485de8ea-cb02-4ee0-a12f-456d38b04325-host-slash\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-system-cni-dir\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysconfig\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-var-lib-kubelet\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.066977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m49kj\" (UniqueName: \"kubernetes.io/projected/485de8ea-cb02-4ee0-a12f-456d38b04325-kube-api-access-m49kj\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-etc-kubernetes\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-k8s-cni-cncf-io\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-device-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.067142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/369dbc6a-5ebb-461b-aed5-3732b372d7d4-tmp\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-cnibin\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-netns\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-cni-multus\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b8ds\" (UniqueName: \"kubernetes.io/projected/a91e882c-0d84-4ca9-8604-c74345b460b4-kube-api-access-7b8ds\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-host\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-tuned\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-socket-dir-parent\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-conf-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysctl-conf\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067571    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/911be198-df59-4893-b47a-687731745194-cni-binary-copy\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-sys-fs\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cni-binary-copy\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cnibin\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.067821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-run\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.068400 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067755    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/485de8ea-cb02-4ee0-a12f-456d38b04325-iptables-alerter-script\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.068400 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-cni-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.068400 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-cni-bin\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.068400 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-kubelet\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.068400 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsn77\" (UniqueName: \"kubernetes.io/projected/911be198-df59-4893-b47a-687731745194-kube-api-access-nsn77\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.068400 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.067984    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 19:46:51.087242 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.087171    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2kvqf"
Jul 28 19:46:51.094515 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.094476    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2kvqf"
Jul 28 19:46:51.147921 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.147886    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:46:51.155155 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.155120    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 19:46:51.168265 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flt6t\" (UniqueName: \"kubernetes.io/projected/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-kube-api-access-flt6t\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.168265 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168259    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m49kj\" (UniqueName: \"kubernetes.io/projected/485de8ea-cb02-4ee0-a12f-456d38b04325-kube-api-access-m49kj\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-etc-kubernetes\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-var-lib-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-k8s-cni-cncf-io\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-device-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/369dbc6a-5ebb-461b-aed5-3732b372d7d4-tmp\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-cni-bin\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-cnibin\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168518    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-netns\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-cni-multus\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.168612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b8ds\" (UniqueName: \"kubernetes.io/projected/a91e882c-0d84-4ca9-8604-c74345b460b4-kube-api-access-7b8ds\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-host\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10cc32c5-1a06-42fe-81c0-a1f8b942496b-serviceca\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-tuned\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-env-overrides\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-socket-dir-parent\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-conf-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysctl-conf\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgm6b\" (UniqueName: \"kubernetes.io/projected/7fc8b706-2189-4aae-9524-85c23861686b-kube-api-access-mgm6b\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovn-node-metrics-cert\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovnkube-script-lib\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/911be198-df59-4893-b47a-687731745194-cni-binary-copy\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-sys-fs\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.168996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cni-binary-copy\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovnkube-config\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.169273 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cnibin\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-run\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10cc32c5-1a06-42fe-81c0-a1f8b942496b-host\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-kubelet\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/485de8ea-cb02-4ee0-a12f-456d38b04325-iptables-alerter-script\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-cni-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-cni-bin\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-kubelet\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169292    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-slash\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsn77\" (UniqueName: \"kubernetes.io/projected/911be198-df59-4893-b47a-687731745194-kube-api-access-nsn77\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-os-release\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169374    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-modprobe-d\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-kubernetes\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-systemd\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvn9t\" (UniqueName: \"kubernetes.io/projected/369dbc6a-5ebb-461b-aed5-3732b372d7d4-kube-api-access-gvn9t\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-run-netns\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-systemd\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.170128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f036892-882f-448d-9dec-b5e936bd831a-agent-certs\") pod \"konnectivity-agent-qrhll\" (UID: \"7f036892-882f-448d-9dec-b5e936bd831a\") " pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-hostroot\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-registration-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npqrc\" (UniqueName: \"kubernetes.io/projected/8e207cd5-c660-4cc1-be4d-ecd66c90d512-kube-api-access-npqrc\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/911be198-df59-4893-b47a-687731745194-multus-daemon-config\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7fc8b706-2189-4aae-9524-85c23861686b-hosts-file\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-etc-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-node-log\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-cni-netd\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f036892-882f-448d-9dec-b5e936bd831a-konnectivity-ca\") pod \"konnectivity-agent-qrhll\" (UID: \"7f036892-882f-448d-9dec-b5e936bd831a\") " pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-os-release\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-lib-modules\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29481a0e-8d07-408c-8ab4-69b8db682394-kubelet-config\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-ovn\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-multus-certs\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.170913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-socket-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-etc-selinux\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4mn8\" (UniqueName: \"kubernetes.io/projected/5ff3f583-c2be-44ff-bd5a-3e2378643f28-kube-api-access-z4mn8\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkbgh\" (UniqueName: \"kubernetes.io/projected/10cc32c5-1a06-42fe-81c0-a1f8b942496b-kube-api-access-bkbgh\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-systemd-units\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-system-cni-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.169989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-log-socket\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysctl-d\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170075    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-sys\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fc8b706-2189-4aae-9524-85c23861686b-tmp-dir\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-run-ovn-kubernetes\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/485de8ea-cb02-4ee0-a12f-456d38b04325-host-slash\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-system-cni-dir\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170162    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysconfig\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.171609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-var-lib-kubelet\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29481a0e-8d07-408c-8ab4-69b8db682394-dbus\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-os-release\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-kubernetes\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-modprobe-d\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-systemd\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-multus-certs\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-socket-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-system-cni-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170698    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-etc-selinux\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.170748    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.170838    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs podName:a91e882c-0d84-4ca9-8604-c74345b460b4 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:51.670792747 +0000 UTC m=+3.039929866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs") pod "network-metrics-daemon-mn7vj" (UID: "a91e882c-0d84-4ca9-8604-c74345b460b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.170960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-etc-kubernetes\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171149    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-sys\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-k8s-cni-cncf-io\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-device-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/485de8ea-cb02-4ee0-a12f-456d38b04325-host-slash\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.172532 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysconfig\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-system-cni-dir\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-var-lib-kubelet\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-kubelet\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-run-netns\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171481    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-cni-bin\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-host-var-lib-cni-multus\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171506    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-hostroot\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-cni-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171558    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-registration-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171669    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-os-release\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171801    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-run\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.172216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.172314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-cnibin\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.172386    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-sys-fs\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.172450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f036892-882f-448d-9dec-b5e936bd831a-konnectivity-ca\") pod \"konnectivity-agent-qrhll\" (UID: \"7f036892-882f-448d-9dec-b5e936bd831a\") " pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.172564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cni-binary-copy\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.172603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/911be198-df59-4893-b47a-687731745194-multus-daemon-config\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.173556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.171154    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysctl-d\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.172859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-host\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.172918    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ff3f583-c2be-44ff-bd5a-3e2378643f28-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8e207cd5-c660-4cc1-be4d-ecd66c90d512-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-lib-modules\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-sysctl-conf\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-socket-dir-parent\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173179    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ff3f583-c2be-44ff-bd5a-3e2378643f28-cnibin\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/911be198-df59-4893-b47a-687731745194-multus-conf-dir\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173621    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/911be198-df59-4893-b47a-687731745194-cni-binary-copy\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.174720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.173694    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/485de8ea-cb02-4ee0-a12f-456d38b04325-iptables-alerter-script\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.176653 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.176547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/369dbc6a-5ebb-461b-aed5-3732b372d7d4-etc-tuned\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.176653 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.176610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/369dbc6a-5ebb-461b-aed5-3732b372d7d4-tmp\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.177358 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.176852    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:46:51.177358 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.176877    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:46:51.177358 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.176892    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cjcqq for pod openshift-network-diagnostics/network-check-target-hjst7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:51.177358 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.176969    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq podName:5ccb39dc-8233-45ee-9dc7-f3befceb92e1 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:51.676948528 +0000 UTC m=+3.046085623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cjcqq" (UniqueName: "kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq") pod "network-check-target-hjst7" (UID: "5ccb39dc-8233-45ee-9dc7-f3befceb92e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:51.179420 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.178517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f036892-882f-448d-9dec-b5e936bd831a-agent-certs\") pod \"konnectivity-agent-qrhll\" (UID: \"7f036892-882f-448d-9dec-b5e936bd831a\") " pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:46:51.179837 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.179811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m49kj\" (UniqueName: \"kubernetes.io/projected/485de8ea-cb02-4ee0-a12f-456d38b04325-kube-api-access-m49kj\") pod \"iptables-alerter-6ddjw\" (UID: \"485de8ea-cb02-4ee0-a12f-456d38b04325\") " pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.181146 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.181120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvn9t\" (UniqueName: \"kubernetes.io/projected/369dbc6a-5ebb-461b-aed5-3732b372d7d4-kube-api-access-gvn9t\") pod \"tuned-fqtbx\" (UID: \"369dbc6a-5ebb-461b-aed5-3732b372d7d4\") " pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.182031 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.182004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4mn8\" (UniqueName: \"kubernetes.io/projected/5ff3f583-c2be-44ff-bd5a-3e2378643f28-kube-api-access-z4mn8\") pod \"multus-additional-cni-plugins-2pdl7\" (UID: \"5ff3f583-c2be-44ff-bd5a-3e2378643f28\") " pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.183154 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.183128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npqrc\" (UniqueName: \"kubernetes.io/projected/8e207cd5-c660-4cc1-be4d-ecd66c90d512-kube-api-access-npqrc\") pod \"aws-ebs-csi-driver-node-qq58w\" (UID: \"8e207cd5-c660-4cc1-be4d-ecd66c90d512\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.185837 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.185790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b8ds\" (UniqueName: \"kubernetes.io/projected/a91e882c-0d84-4ca9-8604-c74345b460b4-kube-api-access-7b8ds\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:51.185948 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.185849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsn77\" (UniqueName: \"kubernetes.io/projected/911be198-df59-4893-b47a-687731745194-kube-api-access-nsn77\") pod \"multus-cr6p8\" (UID: \"911be198-df59-4893-b47a-687731745194\") " pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.270639 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fc8b706-2189-4aae-9524-85c23861686b-tmp-dir\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.270639 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-run-ovn-kubernetes\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29481a0e-8d07-408c-8ab4-69b8db682394-dbus\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flt6t\" (UniqueName: \"kubernetes.io/projected/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-kube-api-access-flt6t\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270717    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-var-lib-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-cni-bin\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10cc32c5-1a06-42fe-81c0-a1f8b942496b-serviceca\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-env-overrides\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgm6b\" (UniqueName: \"kubernetes.io/projected/7fc8b706-2189-4aae-9524-85c23861686b-kube-api-access-mgm6b\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.270885 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovn-node-metrics-cert\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271392 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270914    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovnkube-script-lib\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271392 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovnkube-config\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271392 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10cc32c5-1a06-42fe-81c0-a1f8b942496b-host\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.271392 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.270999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-kubelet\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271392 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fc8b706-2189-4aae-9524-85c23861686b-tmp-dir\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.271392 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-run-ovn-kubernetes\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271452    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-var-lib-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-slash\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271518    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-run-netns\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-systemd\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271574    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7fc8b706-2189-4aae-9524-85c23861686b-hosts-file\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-etc-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-node-log\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-cni-netd\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29481a0e-8d07-408c-8ab4-69b8db682394-kubelet-config\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271681    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29481a0e-8d07-408c-8ab4-69b8db682394-dbus\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.271707 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-ovn\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkbgh\" (UniqueName: \"kubernetes.io/projected/10cc32c5-1a06-42fe-81c0-a1f8b942496b-kube-api-access-bkbgh\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.272311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-systemd-units\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-log-socket\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271932    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271980    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-cni-bin\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272336    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-node-log\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.272430    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272445    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10cc32c5-1a06-42fe-81c0-a1f8b942496b-serviceca\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.272490    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret podName:29481a0e-8d07-408c-8ab4-69b8db682394 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:51.772471314 +0000 UTC m=+3.141608409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret") pod "global-pull-secret-syncer-5fgtz" (UID: "29481a0e-8d07-408c-8ab4-69b8db682394") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272502    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-cni-netd\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271544    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-env-overrides\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272538    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-systemd\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29481a0e-8d07-408c-8ab4-69b8db682394-kubelet-config\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-ovn\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272637    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7fc8b706-2189-4aae-9524-85c23861686b-hosts-file\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.272751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272680    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-etc-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.273374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272788    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-run-netns\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.273374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-run-openvswitch\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.273374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272847    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10cc32c5-1a06-42fe-81c0-a1f8b942496b-host\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.273374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.271077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-slash\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.273374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.272922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-systemd-units\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.273374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.273002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-host-kubelet\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.273374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.273035    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-log-socket\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.273728 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.273610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovnkube-config\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.273879 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.273851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovnkube-script-lib\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.275684 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.275655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-ovn-node-metrics-cert\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.281335 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.281305    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flt6t\" (UniqueName: \"kubernetes.io/projected/5b17a4f7-8b4b-4738-94ac-66b0b21dec03-kube-api-access-flt6t\") pod \"ovnkube-node-gw84m\" (UID: \"5b17a4f7-8b4b-4738-94ac-66b0b21dec03\") " pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.284185 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.284117    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgm6b\" (UniqueName: \"kubernetes.io/projected/7fc8b706-2189-4aae-9524-85c23861686b-kube-api-access-mgm6b\") pod \"node-resolver-ppn7s\" (UID: \"7fc8b706-2189-4aae-9524-85c23861686b\") " pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.285317 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.285248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkbgh\" (UniqueName: \"kubernetes.io/projected/10cc32c5-1a06-42fe-81c0-a1f8b942496b-kube-api-access-bkbgh\") pod \"node-ca-w64pz\" (UID: \"10cc32c5-1a06-42fe-81c0-a1f8b942496b\") " pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.361416 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.361363    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ddjw"
Jul 28 19:46:51.370237 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.370204    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w"
Jul 28 19:46:51.381426 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.381392    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2pdl7"
Jul 28 19:46:51.387980 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.387944    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:46:51.396322 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.396287    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cr6p8"
Jul 28 19:46:51.405603 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.405568    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fqtbx"
Jul 28 19:46:51.415777 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.415744    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w64pz"
Jul 28 19:46:51.424068 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.424038    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ppn7s"
Jul 28 19:46:51.431484 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.431456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:46:51.559827 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.559791    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:46:51.567979 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:51.567943    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc8b706_2189_4aae_9524_85c23861686b.slice/crio-ebf8e4052c6fd685ddd99a4a8b1234ae641834a61d955287a34b1732e4258fbd WatchSource:0}: Error finding container ebf8e4052c6fd685ddd99a4a8b1234ae641834a61d955287a34b1732e4258fbd: Status 404 returned error can't find the container with id ebf8e4052c6fd685ddd99a4a8b1234ae641834a61d955287a34b1732e4258fbd
Jul 28 19:46:51.585964 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:51.585900    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f036892_882f_448d_9dec_b5e936bd831a.slice/crio-c78027ab3360084ef66b576f6446b69925e1f4ec3f861cbd25222f092d3ca4b2 WatchSource:0}: Error finding container c78027ab3360084ef66b576f6446b69925e1f4ec3f861cbd25222f092d3ca4b2: Status 404 returned error can't find the container with id c78027ab3360084ef66b576f6446b69925e1f4ec3f861cbd25222f092d3ca4b2
Jul 28 19:46:51.587007 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:51.586977    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911be198_df59_4893_b47a_687731745194.slice/crio-2e8fe03dc97089c088cdd7ae92cf6df423e5773c67c1e9137b2af456289497be WatchSource:0}: Error finding container 2e8fe03dc97089c088cdd7ae92cf6df423e5773c67c1e9137b2af456289497be: Status 404 returned error can't find the container with id 2e8fe03dc97089c088cdd7ae92cf6df423e5773c67c1e9137b2af456289497be
Jul 28 19:46:51.590893 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:51.590836    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369dbc6a_5ebb_461b_aed5_3732b372d7d4.slice/crio-36389ba34357fd1c6374fc8d1fc725abc872b90f11bcbc439e9709d4863986f5 WatchSource:0}: Error finding container 36389ba34357fd1c6374fc8d1fc725abc872b90f11bcbc439e9709d4863986f5: Status 404 returned error can't find the container with id 36389ba34357fd1c6374fc8d1fc725abc872b90f11bcbc439e9709d4863986f5
Jul 28 19:46:51.593272 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:51.593233    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b17a4f7_8b4b_4738_94ac_66b0b21dec03.slice/crio-104efac0bf46a7c459f459e3dd679fe6034a87edc9a8b01c89d77db98049821d WatchSource:0}: Error finding container 104efac0bf46a7c459f459e3dd679fe6034a87edc9a8b01c89d77db98049821d: Status 404 returned error can't find the container with id 104efac0bf46a7c459f459e3dd679fe6034a87edc9a8b01c89d77db98049821d
Jul 28 19:46:51.594757 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:46:51.594266    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e207cd5_c660_4cc1_be4d_ecd66c90d512.slice/crio-75153061903c3f7399899102f62c799dc735da6eaa32953568ce6a19fa815b74 WatchSource:0}: Error finding container 75153061903c3f7399899102f62c799dc735da6eaa32953568ce6a19fa815b74: Status 404 returned error can't find the container with id 75153061903c3f7399899102f62c799dc735da6eaa32953568ce6a19fa815b74
Jul 28 19:46:51.674439 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.674388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:51.674648 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.674573    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:51.674717 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.674662    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs podName:a91e882c-0d84-4ca9-8604-c74345b460b4 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:52.674640965 +0000 UTC m=+4.043778055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs") pod "network-metrics-daemon-mn7vj" (UID: "a91e882c-0d84-4ca9-8604-c74345b460b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:51.775242 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.775184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:51.775442 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:51.775270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:51.775442 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.775376    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:46:51.775442 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.775404    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:51.775442 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.775406    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:46:51.775442 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.775428    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cjcqq for pod openshift-network-diagnostics/network-check-target-hjst7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:51.775739 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.775477    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq podName:5ccb39dc-8233-45ee-9dc7-f3befceb92e1 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:52.775456306 +0000 UTC m=+4.144593396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjcqq" (UniqueName: "kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq") pod "network-check-target-hjst7" (UID: "5ccb39dc-8233-45ee-9dc7-f3befceb92e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:51.775739 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:51.775499    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret podName:29481a0e-8d07-408c-8ab4-69b8db682394 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:52.775488329 +0000 UTC m=+4.144625425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret") pod "global-pull-secret-syncer-5fgtz" (UID: "29481a0e-8d07-408c-8ab4-69b8db682394") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:52.097257 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.097139    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 19:41:52 +0000 UTC" deadline="2028-02-18 06:13:24.609700173 +0000 UTC"
Jul 28 19:46:52.097257 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.097201    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13666h26m32.512502128s"
Jul 28 19:46:52.252562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.252527    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:52.252745 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.252689    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:46:52.264883 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.264838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerStarted","Data":"3e9da20c56d858a883a4e01f313e516bb840d90b1ee6495682918f54d5e7438b"}
Jul 28 19:46:52.266818 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.266781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cr6p8" event={"ID":"911be198-df59-4893-b47a-687731745194","Type":"ContainerStarted","Data":"2e8fe03dc97089c088cdd7ae92cf6df423e5773c67c1e9137b2af456289497be"}
Jul 28 19:46:52.268487 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.268457    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qrhll" event={"ID":"7f036892-882f-448d-9dec-b5e936bd831a","Type":"ContainerStarted","Data":"c78027ab3360084ef66b576f6446b69925e1f4ec3f861cbd25222f092d3ca4b2"}
Jul 28 19:46:52.270582 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.270553    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ppn7s" event={"ID":"7fc8b706-2189-4aae-9524-85c23861686b","Type":"ContainerStarted","Data":"ebf8e4052c6fd685ddd99a4a8b1234ae641834a61d955287a34b1732e4258fbd"}
Jul 28 19:46:52.271961 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.271930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ddjw" event={"ID":"485de8ea-cb02-4ee0-a12f-456d38b04325","Type":"ContainerStarted","Data":"4510ae6fa8f54f7491bf7663eca8248e1695d65b61298b422b95862f77e9909e"}
Jul 28 19:46:52.273937 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.273910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w" event={"ID":"8e207cd5-c660-4cc1-be4d-ecd66c90d512","Type":"ContainerStarted","Data":"75153061903c3f7399899102f62c799dc735da6eaa32953568ce6a19fa815b74"}
Jul 28 19:46:52.275501 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.275476    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w64pz" event={"ID":"10cc32c5-1a06-42fe-81c0-a1f8b942496b","Type":"ContainerStarted","Data":"2bc1cec32311abcfac03ba09b519950df0ca810e111300c6c1b9a48b6091af95"}
Jul 28 19:46:52.277695 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.277669    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"104efac0bf46a7c459f459e3dd679fe6034a87edc9a8b01c89d77db98049821d"}
Jul 28 19:46:52.279294 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.279268    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fqtbx" event={"ID":"369dbc6a-5ebb-461b-aed5-3732b372d7d4","Type":"ContainerStarted","Data":"36389ba34357fd1c6374fc8d1fc725abc872b90f11bcbc439e9709d4863986f5"}
Jul 28 19:46:52.283819 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.283120    2575 generic.go:356] "Generic (PLEG): container finished" podID="e6ee948d6d60e97c7c0c460ca0eb1e3e" containerID="bee0045f396b0129c34712c8fdf4a6f34ff5c57db66513a7d9116eceddf1e2dd" exitCode=0
Jul 28 19:46:52.283819 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.283156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal" event={"ID":"e6ee948d6d60e97c7c0c460ca0eb1e3e","Type":"ContainerDied","Data":"bee0045f396b0129c34712c8fdf4a6f34ff5c57db66513a7d9116eceddf1e2dd"}
Jul 28 19:46:52.683812 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.683743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:52.684011 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.683971    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:52.684089 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.684040    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs podName:a91e882c-0d84-4ca9-8604-c74345b460b4 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:54.684020339 +0000 UTC m=+6.053157432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs") pod "network-metrics-daemon-mn7vj" (UID: "a91e882c-0d84-4ca9-8604-c74345b460b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:52.787895 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.787853    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:52.788106 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.787953    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret podName:29481a0e-8d07-408c-8ab4-69b8db682394 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:54.787930629 +0000 UTC m=+6.157067717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret") pod "global-pull-secret-syncer-5fgtz" (UID: "29481a0e-8d07-408c-8ab4-69b8db682394") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:52.788306 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.784607    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:52.788457 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:52.788437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:52.788620 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.788595    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:46:52.788667 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.788619    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:46:52.788667 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.788636    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cjcqq for pod openshift-network-diagnostics/network-check-target-hjst7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:52.788753 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:52.788697    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq podName:5ccb39dc-8233-45ee-9dc7-f3befceb92e1 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:54.788679876 +0000 UTC m=+6.157816968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjcqq" (UniqueName: "kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq") pod "network-check-target-hjst7" (UID: "5ccb39dc-8233-45ee-9dc7-f3befceb92e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:53.097855 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:53.097805    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 19:41:52 +0000 UTC" deadline="2028-02-06 16:00:36.183630073 +0000 UTC"
Jul 28 19:46:53.097855 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:53.097853    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13388h13m43.085781966s"
Jul 28 19:46:53.254014 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:53.253332    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:53.254014 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:53.253345    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:53.254014 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:53.253472    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:46:53.254014 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:53.253920    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:46:53.291364 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:53.290675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal" event={"ID":"0a426c9c0dc23284d58a8b55be14deec","Type":"ContainerStarted","Data":"9584224926eebb4e69683a42942fb1d523cfa6c85fb903cb6da0ca2f33c0b0ff"}
Jul 28 19:46:53.308067 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:53.308001    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-236.ec2.internal" podStartSLOduration=2.307975146 podStartE2EDuration="2.307975146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:46:53.307343962 +0000 UTC m=+4.676481077" watchObservedRunningTime="2026-07-28 19:46:53.307975146 +0000 UTC m=+4.677112260"
Jul 28 19:46:53.308292 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:53.308204    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal" event={"ID":"e6ee948d6d60e97c7c0c460ca0eb1e3e","Type":"ContainerStarted","Data":"07b0d7498239615bd60bae974ba423de0d8cb4b66e039a2711b24b46484a8d44"}
Jul 28 19:46:54.252804 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:54.252766    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:54.253397 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.252932    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:46:54.703360 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:54.703259    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:54.703552 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.703426    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:54.703552 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.703498    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs podName:a91e882c-0d84-4ca9-8604-c74345b460b4 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:58.703477888 +0000 UTC m=+10.072614984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs") pod "network-metrics-daemon-mn7vj" (UID: "a91e882c-0d84-4ca9-8604-c74345b460b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:54.805261 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:54.804400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:54.805261 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:54.804465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:54.805261 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.804599    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:54.805261 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.804670    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret podName:29481a0e-8d07-408c-8ab4-69b8db682394 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:58.804648972 +0000 UTC m=+10.173786062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret") pod "global-pull-secret-syncer-5fgtz" (UID: "29481a0e-8d07-408c-8ab4-69b8db682394") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:54.805261 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.805114    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:46:54.805261 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.805133    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:46:54.805261 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.805147    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cjcqq for pod openshift-network-diagnostics/network-check-target-hjst7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:54.805261 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:54.805197    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq podName:5ccb39dc-8233-45ee-9dc7-f3befceb92e1 nodeName:}" failed. No retries permitted until 2026-07-28 19:46:58.805181793 +0000 UTC m=+10.174318884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjcqq" (UniqueName: "kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq") pod "network-check-target-hjst7" (UID: "5ccb39dc-8233-45ee-9dc7-f3befceb92e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:55.253454 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:55.253410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:55.253454 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:55.253456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:55.254022 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:55.253569    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:46:55.254022 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:55.253689    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:46:56.252819 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:56.252340    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:56.252819 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:56.252473    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:46:57.252646 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:57.252611    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:57.253169 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:57.252740    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:46:57.253169 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:57.253044    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:57.253169 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:57.253113    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:46:58.252864 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:58.252825    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:58.253342 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.253005    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:46:58.743059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:58.742383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:46:58.743059 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.742547    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:58.743059 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.742629    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs podName:a91e882c-0d84-4ca9-8604-c74345b460b4 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:06.742608814 +0000 UTC m=+18.111745908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs") pod "network-metrics-daemon-mn7vj" (UID: "a91e882c-0d84-4ca9-8604-c74345b460b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:46:58.842787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:58.842744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:58.842965 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:58.842811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:58.842965 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.842941    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:58.843095 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.843011    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret podName:29481a0e-8d07-408c-8ab4-69b8db682394 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:06.842987749 +0000 UTC m=+18.212124863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret") pod "global-pull-secret-syncer-5fgtz" (UID: "29481a0e-8d07-408c-8ab4-69b8db682394") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:46:58.843495 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.843473    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:46:58.843595 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.843501    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:46:58.843595 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.843515    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cjcqq for pod openshift-network-diagnostics/network-check-target-hjst7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:58.843595 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:58.843565    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq podName:5ccb39dc-8233-45ee-9dc7-f3befceb92e1 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:06.843549942 +0000 UTC m=+18.212687036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjcqq" (UniqueName: "kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq") pod "network-check-target-hjst7" (UID: "5ccb39dc-8233-45ee-9dc7-f3befceb92e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:46:59.253593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:59.253558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:46:59.254107 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:46:59.253633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:46:59.254107 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:59.253719    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:46:59.254107 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:46:59.253832    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:00.252312 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:00.252271    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:00.252505 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:00.252438    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:01.254281 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:01.254071    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:01.254281 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:01.254217    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:01.256327 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:01.254930    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:01.256327 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:01.255040    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:02.252354 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:02.252314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:02.252560 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:02.252466    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:03.252986 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:03.252947    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:03.253480 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:03.252958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:03.253480 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:03.253096    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:03.253480 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:03.253124    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:04.252847 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:04.252806    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:04.253011 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:04.252948    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:05.252625 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:05.252582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:05.252798 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:05.252694    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:05.252798 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:05.252758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:05.252928 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:05.252882    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:06.252637 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:06.252588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:06.253126 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.252747    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:06.811849 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:06.811804    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:06.812044 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.811983    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:47:06.812094 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.812058    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs podName:a91e882c-0d84-4ca9-8604-c74345b460b4 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:22.812041761 +0000 UTC m=+34.181178848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs") pod "network-metrics-daemon-mn7vj" (UID: "a91e882c-0d84-4ca9-8604-c74345b460b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:47:06.912896 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:06.912856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:06.912896 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:06.912909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:06.913134 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.913024    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:47:06.913134 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.913038    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:47:06.913134 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.913057    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:47:06.913134 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.913070    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cjcqq for pod openshift-network-diagnostics/network-check-target-hjst7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:47:06.913134 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.913094    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret podName:29481a0e-8d07-408c-8ab4-69b8db682394 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:22.913074949 +0000 UTC m=+34.282212057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret") pod "global-pull-secret-syncer-5fgtz" (UID: "29481a0e-8d07-408c-8ab4-69b8db682394") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:47:06.913134 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:06.913112    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq podName:5ccb39dc-8233-45ee-9dc7-f3befceb92e1 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:22.913103367 +0000 UTC m=+34.282240455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjcqq" (UniqueName: "kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq") pod "network-check-target-hjst7" (UID: "5ccb39dc-8233-45ee-9dc7-f3befceb92e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:47:07.252600 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:07.252567    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:07.252764 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:07.252699    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:07.252764 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:07.252739    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:07.253160 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:07.252821    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:08.252393 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:08.252354    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:08.252588 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:08.252491    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:09.253433 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:09.253394    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:09.253871 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:09.253510    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:09.253871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:09.253568    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:09.253871 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:09.253683    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:10.252629 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:10.252586    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:10.252824 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:10.252728    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:11.252536 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:11.252493    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:11.253122 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:11.252624    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:11.253122 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:11.252665    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:11.253122 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:11.252715    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:12.252393 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.252049    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:12.252519 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:12.252483    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:12.353393 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.353307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w" event={"ID":"8e207cd5-c660-4cc1-be4d-ecd66c90d512","Type":"ContainerStarted","Data":"8dc343e97299d96c5c70bc0a882fe2d5b9ecd369fde797c5db307dd0d6804425"}
Jul 28 19:47:12.354769 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.354739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w64pz" event={"ID":"10cc32c5-1a06-42fe-81c0-a1f8b942496b","Type":"ContainerStarted","Data":"467c31113ae69cca1104f5c7cf70a3eccaceefa9e4d2b465bec1fb39521c74d7"}
Jul 28 19:47:12.357761 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.357739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"efa411907f9fbd4793ac28c5ab6ac43aa8b2502c74f8311db3e8c5350ce7892e"}
Jul 28 19:47:12.357879 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.357797    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"d63b2a93bd5f8baa258760e394d106625c4ffc9596c3ff866568433e3668df54"}
Jul 28 19:47:12.357879 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.357868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"80e093d08a36e0bbb7def916b5057d951c6ee5319c5dd08d709126aaf5fa4e36"}
Jul 28 19:47:12.358011 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.357903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"b29afcbbd1e1509d677ae52f3102d19c835e4e526a464457340d90e88a0fea0a"}
Jul 28 19:47:12.358011 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.357948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"71c79da99e718fb053d6d18ddaf228857dad691d42d21002a6a1a55db30e04fa"}
Jul 28 19:47:12.358011 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.357993    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"16579a8d5f39b784cb6d294022972838a6f106eeb89f2deec398341f5038bf50"}
Jul 28 19:47:12.359224 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.359207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fqtbx" event={"ID":"369dbc6a-5ebb-461b-aed5-3732b372d7d4","Type":"ContainerStarted","Data":"ce20b3f23be4ab39605a294bd15d28f20b1cf4adfe660c237f54aee260236106"}
Jul 28 19:47:12.360626 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.360603    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ff3f583-c2be-44ff-bd5a-3e2378643f28" containerID="2cfa6f0cd323e58f1c61e50ce62ab8bc9796476bee434f1239b9df01679d9f2a" exitCode=0
Jul 28 19:47:12.360724 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.360665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerDied","Data":"2cfa6f0cd323e58f1c61e50ce62ab8bc9796476bee434f1239b9df01679d9f2a"}
Jul 28 19:47:12.362390 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.362365    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cr6p8" event={"ID":"911be198-df59-4893-b47a-687731745194","Type":"ContainerStarted","Data":"a5137404746a08ba99a7485dab3483426e27fba64cac08d5cc833b6c7a5c6034"}
Jul 28 19:47:12.363846 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.363829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qrhll" event={"ID":"7f036892-882f-448d-9dec-b5e936bd831a","Type":"ContainerStarted","Data":"60e12ca8dbefd5cd38a5e2329bc67e26c11d43fa14439c84738fb2af3a760d8b"}
Jul 28 19:47:12.365562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.365533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ppn7s" event={"ID":"7fc8b706-2189-4aae-9524-85c23861686b","Type":"ContainerStarted","Data":"4364931db1254ad21a9ca56fc43eb9862e8352ff6b2285d850b1cec7db058001"}
Jul 28 19:47:12.370586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.370546    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w64pz" podStartSLOduration=10.564594795 podStartE2EDuration="22.37053276s" totalImagesPullingTime="11.805937965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:12.370340458 +0000 UTC m=+23.739477569" watchObservedRunningTime="2026-07-28 19:47:12.37053276 +0000 UTC m=+23.739669873"
Jul 28 19:47:12.370954 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.370934    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-236.ec2.internal" podStartSLOduration=21.370929931 podStartE2EDuration="21.370929931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:46:53.326777521 +0000 UTC m=+4.695914636" watchObservedRunningTime="2026-07-28 19:47:12.370929931 +0000 UTC m=+23.740067040"
Jul 28 19:47:12.384884 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.384842    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qrhll" podStartSLOduration=10.565677118 podStartE2EDuration="22.38482877s" totalImagesPullingTime="11.819151652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:12.384788766 +0000 UTC m=+23.753925873" watchObservedRunningTime="2026-07-28 19:47:12.38482877 +0000 UTC m=+23.753965882"
Jul 28 19:47:12.403968 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.403921    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cr6p8" podStartSLOduration=2.386614759 podStartE2EDuration="22.403901967s" totalImagesPullingTime="20.017287208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:12.403434615 +0000 UTC m=+23.772571726" watchObservedRunningTime="2026-07-28 19:47:12.403901967 +0000 UTC m=+23.773039080"
Jul 28 19:47:12.417535 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.417475    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ppn7s" podStartSLOduration=2.447112146 podStartE2EDuration="22.417456188s" totalImagesPullingTime="19.970344042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:12.417124045 +0000 UTC m=+23.786261170" watchObservedRunningTime="2026-07-28 19:47:12.417456188 +0000 UTC m=+23.786593299"
Jul 28 19:47:12.455661 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:12.455603    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fqtbx" podStartSLOduration=2.445887219 podStartE2EDuration="22.455583096s" totalImagesPullingTime="20.009695877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:12.455267694 +0000 UTC m=+23.824404804" watchObservedRunningTime="2026-07-28 19:47:12.455583096 +0000 UTC m=+23.824720206"
Jul 28 19:47:13.252633 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:13.252573    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:13.252633 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:13.252604    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:13.252816 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:13.252704    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:13.253123 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:13.253090    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:13.311824 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:13.311794    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 19:47:13.369626 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:13.369586    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ddjw" event={"ID":"485de8ea-cb02-4ee0-a12f-456d38b04325","Type":"ContainerStarted","Data":"58caac486aa84d5b13c09901137fd7bb2577053e039aa4711befdc7744b1e3dd"}
Jul 28 19:47:13.371814 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:13.371788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w" event={"ID":"8e207cd5-c660-4cc1-be4d-ecd66c90d512","Type":"ContainerStarted","Data":"22ad5ec89fba7b76082d3f49cd4da432db369f8fc91dc17c141cf4703ff3c15c"}
Jul 28 19:47:13.384218 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:13.384149    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6ddjw" podStartSLOduration=3.387911218 podStartE2EDuration="23.384134192s" totalImagesPullingTime="19.996222974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:13.383909979 +0000 UTC m=+24.753047089" watchObservedRunningTime="2026-07-28 19:47:13.384134192 +0000 UTC m=+24.753271301"
Jul 28 19:47:13.459155 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:13.459123    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:47:13.459828 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:13.459805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:47:14.127184 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:14.127057    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T19:47:13.31181999Z","UUID":"f7af3ad9-cd33-4df0-958e-7341a3db69b3","Handler":null,"Name":"","Endpoint":""}
Jul 28 19:47:14.129256 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:14.129228    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 19:47:14.129395 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:14.129277    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 19:47:14.252459 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:14.252425    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:14.252641 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:14.252597    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:14.374205 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:14.374011    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:47:14.374713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:14.374694    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qrhll"
Jul 28 19:47:15.252183 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:15.252142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:15.252385 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:15.252211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:15.252385 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:15.252297    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:15.252499 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:15.252424    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:15.379114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:15.379077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w" event={"ID":"8e207cd5-c660-4cc1-be4d-ecd66c90d512","Type":"ContainerStarted","Data":"ed769fbe7e5f478ea9fcc46e8af6b69380ce24d7e87c1539fb523f951407df79"}
Jul 28 19:47:15.383009 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:15.382966    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"b32b929849cce8fce9d2188f28553a0b6439e393805063b37244ed07f32f90d3"}
Jul 28 19:47:15.397243 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:15.397202    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qq58w" podStartSLOduration=2.946870413 podStartE2EDuration="25.39718642s" totalImagesPullingTime="22.450316007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:15.396649474 +0000 UTC m=+26.765786588" watchObservedRunningTime="2026-07-28 19:47:15.39718642 +0000 UTC m=+26.766323527"
Jul 28 19:47:16.252376 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:16.252345    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:16.252569 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:16.252492    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:17.252289 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:17.252072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:17.253110 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:17.252078    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:17.253110 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:17.252400    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:17.253110 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:17.252468    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:17.390105 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:17.390069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" event={"ID":"5b17a4f7-8b4b-4738-94ac-66b0b21dec03","Type":"ContainerStarted","Data":"491e06ae8d12b1a631ec1b08ad6e889a7e9d6cd99992f6dba502de51375494b6"}
Jul 28 19:47:17.390373 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:17.390354    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:47:17.391958 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:17.391935    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ff3f583-c2be-44ff-bd5a-3e2378643f28" containerID="a5f5df10aaa2118cab6a6d272e0d3a1eebf1f1afb7baec9fd979f14277ed7f27" exitCode=0
Jul 28 19:47:17.392069 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:17.391968    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerDied","Data":"a5f5df10aaa2118cab6a6d272e0d3a1eebf1f1afb7baec9fd979f14277ed7f27"}
Jul 28 19:47:17.406806 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:17.406783    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:47:17.422131 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:17.422090    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m" podStartSLOduration=7.322989497 podStartE2EDuration="27.422075674s" totalImagesPullingTime="20.099086177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:17.421404346 +0000 UTC m=+28.790541456" watchObservedRunningTime="2026-07-28 19:47:17.422075674 +0000 UTC m=+28.791212783"
Jul 28 19:47:18.252522 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.252494    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:18.252956 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:18.252598    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:18.394600 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.394572    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:47:18.394748 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.394656    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:47:18.409748 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.409723    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:47:18.778322 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.778076    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5fgtz"]
Jul 28 19:47:18.778482 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.778413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:18.778541 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:18.778523    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:18.780722 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.780694    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mn7vj"]
Jul 28 19:47:18.780859 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.780809    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:18.780930 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:18.780910    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:18.788227 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.788205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hjst7"]
Jul 28 19:47:18.788337 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:18.788288    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:18.788395 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:18.788376    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:19.399143 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:19.399110    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ff3f583-c2be-44ff-bd5a-3e2378643f28" containerID="132b47753a22eae74776dfb21a3da4d729eb1e6305bcf04a3370beed931e352c" exitCode=0
Jul 28 19:47:19.399534 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:19.399208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerDied","Data":"132b47753a22eae74776dfb21a3da4d729eb1e6305bcf04a3370beed931e352c"}
Jul 28 19:47:20.253046 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:20.253005    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:20.253223 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:20.253111    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:20.253223 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:20.253201    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:20.253223 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:20.253212    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:20.253328 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:20.253280    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:20.253366 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:20.253336    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:21.406564 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:21.406529    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ff3f583-c2be-44ff-bd5a-3e2378643f28" containerID="9f19bbc3b2965af96324d9b24c159cd6f96ed171f587f277554ef79bfcf88779" exitCode=0
Jul 28 19:47:21.407289 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:21.406572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerDied","Data":"9f19bbc3b2965af96324d9b24c159cd6f96ed171f587f277554ef79bfcf88779"}
Jul 28 19:47:22.252746 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:22.252714    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:22.252941 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:22.252713    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:22.252941 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.252832    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:22.252941 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.252920    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:22.253071 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:22.252714    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:22.253071 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.253007    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:22.833007 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:22.832970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:22.833471 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.833129    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:47:22.833471 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.833252    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs podName:a91e882c-0d84-4ca9-8604-c74345b460b4 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:54.833234116 +0000 UTC m=+66.202371205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs") pod "network-metrics-daemon-mn7vj" (UID: "a91e882c-0d84-4ca9-8604-c74345b460b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:47:22.933658 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:22.933619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:22.933858 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:22.933681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:22.933858 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.933790    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:47:22.933858 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.933807    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:47:22.933858 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.933818    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:47:22.933858 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.933831    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cjcqq for pod openshift-network-diagnostics/network-check-target-hjst7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:47:22.934074 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.933877    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret podName:29481a0e-8d07-408c-8ab4-69b8db682394 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:54.93385908 +0000 UTC m=+66.302996173 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret") pod "global-pull-secret-syncer-5fgtz" (UID: "29481a0e-8d07-408c-8ab4-69b8db682394") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:47:22.934074 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:22.933898    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq podName:5ccb39dc-8233-45ee-9dc7-f3befceb92e1 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:54.933886891 +0000 UTC m=+66.303023984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cjcqq" (UniqueName: "kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq") pod "network-check-target-hjst7" (UID: "5ccb39dc-8233-45ee-9dc7-f3befceb92e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:47:24.252355 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:24.252315    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:24.252930 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:24.252361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:24.252930 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:24.252369    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:24.252930 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:24.252428    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:24.252930 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:24.252544    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mn7vj" podUID="a91e882c-0d84-4ca9-8604-c74345b460b4"
Jul 28 19:47:24.252930 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:24.252619    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjst7" podUID="5ccb39dc-8233-45ee-9dc7-f3befceb92e1"
Jul 28 19:47:25.255576 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.255551    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:25.255928 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:25.255660    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5fgtz" podUID="29481a0e-8d07-408c-8ab4-69b8db682394"
Jul 28 19:47:25.419444 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.419364    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerStarted","Data":"a92d39cf242fa83e69042b13053428b231f6cd58413c02338477173b1529590a"}
Jul 28 19:47:25.447752 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.447731    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-236.ec2.internal" event="NodeReady"
Jul 28 19:47:25.447884 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.447872    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 19:47:25.479854 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.479825    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f7b6555bf-w6jwc"]
Jul 28 19:47:25.481573 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.481557    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.484140 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.484121    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 19:47:25.484259 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.484144    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 19:47:25.484259 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.484120    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 19:47:25.484401 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.484375    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c54t5\""
Jul 28 19:47:25.489331 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.489311    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c6qcg"]
Jul 28 19:47:25.489637 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.489619    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 19:47:25.491124 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.491108    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.491451 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.491425    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pzgh8"]
Jul 28 19:47:25.493475 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.493401    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pzgh8"
Jul 28 19:47:25.493475 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.493464    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 19:47:25.493634 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.493498    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wfpzj\""
Jul 28 19:47:25.494781 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.494765    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 19:47:25.495722 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.495704    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f7b6555bf-w6jwc"]
Jul 28 19:47:25.497065 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.497043    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 19:47:25.497157 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.497067    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zg9s9\""
Jul 28 19:47:25.497157 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.497090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 19:47:25.497352 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.497052    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 19:47:25.507403 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.507377    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c6qcg"]
Jul 28 19:47:25.507936 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.507917    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pzgh8"]
Jul 28 19:47:25.653411 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvtnf\" (UniqueName: \"kubernetes.io/projected/8b2a401b-408e-4a7d-950c-439b1fe45b2b-kube-api-access-bvtnf\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.653411 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-trusted-ca\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.653648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zmdk\" (UniqueName: \"kubernetes.io/projected/13d39a56-8c65-4078-8c72-800f55399d95-kube-api-access-5zmdk\") pod \"ingress-canary-pzgh8\" (UID: \"13d39a56-8c65-4078-8c72-800f55399d95\") " pod="openshift-ingress-canary/ingress-canary-pzgh8"
Jul 28 19:47:25.653648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653540    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-bound-sa-token\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.653648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5xvg\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-kube-api-access-d5xvg\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.653648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.653779 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.653779 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13d39a56-8c65-4078-8c72-800f55399d95-cert\") pod \"ingress-canary-pzgh8\" (UID: \"13d39a56-8c65-4078-8c72-800f55399d95\") " pod="openshift-ingress-canary/ingress-canary-pzgh8"
Jul 28 19:47:25.653779 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-ca-trust-extracted\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.653779 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-certificates\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.653779 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-image-registry-private-configuration\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.653779 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-installation-pull-secrets\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.653962 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b2a401b-408e-4a7d-950c-439b1fe45b2b-config-volume\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.653962 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.653798    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2a401b-408e-4a7d-950c-439b1fe45b2b-tmp-dir\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.754716 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13d39a56-8c65-4078-8c72-800f55399d95-cert\") pod \"ingress-canary-pzgh8\" (UID: \"13d39a56-8c65-4078-8c72-800f55399d95\") " pod="openshift-ingress-canary/ingress-canary-pzgh8"
Jul 28 19:47:25.754838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-ca-trust-extracted\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.754838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-certificates\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.754838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-image-registry-private-configuration\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.754838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-installation-pull-secrets\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.754838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b2a401b-408e-4a7d-950c-439b1fe45b2b-config-volume\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.754838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2a401b-408e-4a7d-950c-439b1fe45b2b-tmp-dir\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.755114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvtnf\" (UniqueName: \"kubernetes.io/projected/8b2a401b-408e-4a7d-950c-439b1fe45b2b-kube-api-access-bvtnf\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.755114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-trusted-ca\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.755114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zmdk\" (UniqueName: \"kubernetes.io/projected/13d39a56-8c65-4078-8c72-800f55399d95-kube-api-access-5zmdk\") pod \"ingress-canary-pzgh8\" (UID: \"13d39a56-8c65-4078-8c72-800f55399d95\") " pod="openshift-ingress-canary/ingress-canary-pzgh8"
Jul 28 19:47:25.755114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-bound-sa-token\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.755114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.754999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5xvg\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-kube-api-access-d5xvg\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.755114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.755020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.755114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.755052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.755495 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:25.755150    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:47:25.755495 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:25.755187    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f7b6555bf-w6jwc: secret "image-registry-tls" not found
Jul 28 19:47:25.755495 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:25.755241    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls podName:1d192865-41b1-448f-9a36-3cbc0ef0f3dd nodeName:}" failed. No retries permitted until 2026-07-28 19:47:26.255222877 +0000 UTC m=+37.624359965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls") pod "image-registry-f7b6555bf-w6jwc" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd") : secret "image-registry-tls" not found
Jul 28 19:47:25.755495 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.755257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-ca-trust-extracted\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.755495 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.755394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2a401b-408e-4a7d-950c-439b1fe45b2b-tmp-dir\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.755873 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.755516    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-certificates\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.755873 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:25.755603    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:47:25.755873 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:25.755655    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls podName:8b2a401b-408e-4a7d-950c-439b1fe45b2b nodeName:}" failed. No retries permitted until 2026-07-28 19:47:26.255636034 +0000 UTC m=+37.624773128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls") pod "dns-default-c6qcg" (UID: "8b2a401b-408e-4a7d-950c-439b1fe45b2b") : secret "dns-default-metrics-tls" not found
Jul 28 19:47:25.756003 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.755968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b2a401b-408e-4a7d-950c-439b1fe45b2b-config-volume\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.756254 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.756235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-trusted-ca\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.759159 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.759134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-installation-pull-secrets\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.759280 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.759209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-image-registry-private-configuration\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.759280 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.759255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13d39a56-8c65-4078-8c72-800f55399d95-cert\") pod \"ingress-canary-pzgh8\" (UID: \"13d39a56-8c65-4078-8c72-800f55399d95\") " pod="openshift-ingress-canary/ingress-canary-pzgh8"
Jul 28 19:47:25.763932 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.763908    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5xvg\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-kube-api-access-d5xvg\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.764151 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.764120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zmdk\" (UniqueName: \"kubernetes.io/projected/13d39a56-8c65-4078-8c72-800f55399d95-kube-api-access-5zmdk\") pod \"ingress-canary-pzgh8\" (UID: \"13d39a56-8c65-4078-8c72-800f55399d95\") " pod="openshift-ingress-canary/ingress-canary-pzgh8"
Jul 28 19:47:25.764518 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.764489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvtnf\" (UniqueName: \"kubernetes.io/projected/8b2a401b-408e-4a7d-950c-439b1fe45b2b-kube-api-access-bvtnf\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:25.764893 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.764872    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-bound-sa-token\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:25.811486 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.811438    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pzgh8"
Jul 28 19:47:25.939530 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:25.939351    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pzgh8"]
Jul 28 19:47:25.942720 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:25.942695    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d39a56_8c65_4078_8c72_800f55399d95.slice/crio-d1276ededccd6f54e782d2d0d17578804db59f7ba2413beb432cdc35bb0312fe WatchSource:0}: Error finding container d1276ededccd6f54e782d2d0d17578804db59f7ba2413beb432cdc35bb0312fe: Status 404 returned error can't find the container with id d1276ededccd6f54e782d2d0d17578804db59f7ba2413beb432cdc35bb0312fe
Jul 28 19:47:26.252570 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.252533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:26.252783 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.252722    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:26.255358 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.255336    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 19:47:26.256393 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.256370    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lhtrs\""
Jul 28 19:47:26.256733 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.256410    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 19:47:26.256733 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.256431    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 19:47:26.256733 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.256442    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l4wgt\""
Jul 28 19:47:26.258606 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.258582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:26.258699 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.258626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:26.258764 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:26.258734    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:47:26.258811 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:26.258792    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls podName:8b2a401b-408e-4a7d-950c-439b1fe45b2b nodeName:}" failed. No retries permitted until 2026-07-28 19:47:27.258772751 +0000 UTC m=+38.627909842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls") pod "dns-default-c6qcg" (UID: "8b2a401b-408e-4a7d-950c-439b1fe45b2b") : secret "dns-default-metrics-tls" not found
Jul 28 19:47:26.258871 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:26.258822    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:47:26.258871 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:26.258836    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f7b6555bf-w6jwc: secret "image-registry-tls" not found
Jul 28 19:47:26.258955 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:26.258890    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls podName:1d192865-41b1-448f-9a36-3cbc0ef0f3dd nodeName:}" failed. No retries permitted until 2026-07-28 19:47:27.258874945 +0000 UTC m=+38.628012052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls") pod "image-registry-f7b6555bf-w6jwc" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd") : secret "image-registry-tls" not found
Jul 28 19:47:26.422907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.422865    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pzgh8" event={"ID":"13d39a56-8c65-4078-8c72-800f55399d95","Type":"ContainerStarted","Data":"d1276ededccd6f54e782d2d0d17578804db59f7ba2413beb432cdc35bb0312fe"}
Jul 28 19:47:26.425559 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.425530    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ff3f583-c2be-44ff-bd5a-3e2378643f28" containerID="a92d39cf242fa83e69042b13053428b231f6cd58413c02338477173b1529590a" exitCode=0
Jul 28 19:47:26.425671 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:26.425574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerDied","Data":"a92d39cf242fa83e69042b13053428b231f6cd58413c02338477173b1529590a"}
Jul 28 19:47:27.014307 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.014275    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9swpc"]
Jul 28 19:47:27.027700 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.027658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9swpc"]
Jul 28 19:47:27.027868 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.027807    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.030370 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.030338    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 19:47:27.030370 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.030362    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t6cqg\""
Jul 28 19:47:27.030544 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.030347    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 19:47:27.031360 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.031339    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 19:47:27.031472 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.031396    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 19:47:27.166595 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.166557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/95002a34-c9fa-467c-8cfe-93f289f3eb56-crio-socket\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.166775 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.166606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.166775 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.166689    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.166775 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.166722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd55f\" (UniqueName: \"kubernetes.io/projected/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-api-access-pd55f\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.166775 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.166754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/95002a34-c9fa-467c-8cfe-93f289f3eb56-data-volume\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.255830 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.255797    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:27.258560 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.258537    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 19:47:27.267129 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:27.267129 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/95002a34-c9fa-467c-8cfe-93f289f3eb56-crio-socket\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.267129 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:27.267361 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.267361 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267237    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:47:27.267361 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267258    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:47:27.267361 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267286    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:47:27.267361 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267305    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f7b6555bf-w6jwc: secret "image-registry-tls" not found
Jul 28 19:47:27.267361 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267324    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/95002a34-c9fa-467c-8cfe-93f289f3eb56-crio-socket\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.267361 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267289    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm podName:95002a34-c9fa-467c-8cfe-93f289f3eb56 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:27.767276542 +0000 UTC m=+39.136413629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9swpc" (UID: "95002a34-c9fa-467c-8cfe-93f289f3eb56") : configmap "kube-rbac-proxy" not found
Jul 28 19:47:27.267361 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.267713 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267367    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls podName:8b2a401b-408e-4a7d-950c-439b1fe45b2b nodeName:}" failed. No retries permitted until 2026-07-28 19:47:29.267353787 +0000 UTC m=+40.636490875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls") pod "dns-default-c6qcg" (UID: "8b2a401b-408e-4a7d-950c-439b1fe45b2b") : secret "dns-default-metrics-tls" not found
Jul 28 19:47:27.267713 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267406    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:27.267713 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267409    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls podName:1d192865-41b1-448f-9a36-3cbc0ef0f3dd nodeName:}" failed. No retries permitted until 2026-07-28 19:47:29.267391942 +0000 UTC m=+40.636529041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls") pod "image-registry-f7b6555bf-w6jwc" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd") : secret "image-registry-tls" not found
Jul 28 19:47:27.267713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd55f\" (UniqueName: \"kubernetes.io/projected/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-api-access-pd55f\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.267713 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.267435    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls podName:95002a34-c9fa-467c-8cfe-93f289f3eb56 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:27.767424052 +0000 UTC m=+39.136561140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9swpc" (UID: "95002a34-c9fa-467c-8cfe-93f289f3eb56") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:27.267713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/95002a34-c9fa-467c-8cfe-93f289f3eb56-data-volume\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.267898 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.267761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/95002a34-c9fa-467c-8cfe-93f289f3eb56-data-volume\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.282895 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.282742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd55f\" (UniqueName: \"kubernetes.io/projected/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-api-access-pd55f\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.431236 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.431200    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ff3f583-c2be-44ff-bd5a-3e2378643f28" containerID="f9c277751b97ae5b41643916485c9282b6c39dcda3518c87da0fd01140a8edae" exitCode=0
Jul 28 19:47:27.431391 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.431280    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerDied","Data":"f9c277751b97ae5b41643916485c9282b6c39dcda3518c87da0fd01140a8edae"}
Jul 28 19:47:27.497418 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.497387    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd"]
Jul 28 19:47:27.517624 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.517550    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd"]
Jul 28 19:47:27.517720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.517642    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd"
Jul 28 19:47:27.520706 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.520685    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 19:47:27.520996 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.520973    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rkgtr\""
Jul 28 19:47:27.521153 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.521137    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 19:47:27.670963 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.670932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh7hm\" (UniqueName: \"kubernetes.io/projected/828d02b5-014c-4a4e-9e85-70d4ff4bf722-kube-api-access-lh7hm\") pod \"migrator-6865c9967-87wrd\" (UID: \"828d02b5-014c-4a4e-9e85-70d4ff4bf722\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd"
Jul 28 19:47:27.771508 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.771431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.771508 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.771479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh7hm\" (UniqueName: \"kubernetes.io/projected/828d02b5-014c-4a4e-9e85-70d4ff4bf722-kube-api-access-lh7hm\") pod \"migrator-6865c9967-87wrd\" (UID: \"828d02b5-014c-4a4e-9e85-70d4ff4bf722\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd"
Jul 28 19:47:27.771508 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.771500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:27.771707 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.771554    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:47:27.771707 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.771586    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:27.771707 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.771627    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm podName:95002a34-c9fa-467c-8cfe-93f289f3eb56 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:28.771611944 +0000 UTC m=+40.140749032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9swpc" (UID: "95002a34-c9fa-467c-8cfe-93f289f3eb56") : configmap "kube-rbac-proxy" not found
Jul 28 19:47:27.771707 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:27.771642    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls podName:95002a34-c9fa-467c-8cfe-93f289f3eb56 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:28.771635862 +0000 UTC m=+40.140772950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9swpc" (UID: "95002a34-c9fa-467c-8cfe-93f289f3eb56") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:27.779811 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.779768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh7hm\" (UniqueName: \"kubernetes.io/projected/828d02b5-014c-4a4e-9e85-70d4ff4bf722-kube-api-access-lh7hm\") pod \"migrator-6865c9967-87wrd\" (UID: \"828d02b5-014c-4a4e-9e85-70d4ff4bf722\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd"
Jul 28 19:47:27.828097 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:27.828063    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd"
Jul 28 19:47:28.437967 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:28.437934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" event={"ID":"5ff3f583-c2be-44ff-bd5a-3e2378643f28","Type":"ContainerStarted","Data":"ea142373a93cf35b69db085fa22cadb2068d544c39e2f8140115759cf48e9021"}
Jul 28 19:47:28.460766 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:28.460706    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2pdl7" podStartSLOduration=7.97852315 podStartE2EDuration="38.460689851s" totalImagesPullingTime="30.482166701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:28.459385611 +0000 UTC m=+39.828522720" watchObservedRunningTime="2026-07-28 19:47:28.460689851 +0000 UTC m=+39.829826961"
Jul 28 19:47:28.628117 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:28.628086    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ppn7s_7fc8b706-2189-4aae-9524-85c23861686b/dns-node-resolver/0.log"
Jul 28 19:47:28.667699 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:28.667667    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd"]
Jul 28 19:47:28.696211 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:28.696182    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828d02b5_014c_4a4e_9e85_70d4ff4bf722.slice/crio-912dd16a6a3825c44329d87221d65b368827264802bb71758a69e52c218c75e8 WatchSource:0}: Error finding container 912dd16a6a3825c44329d87221d65b368827264802bb71758a69e52c218c75e8: Status 404 returned error can't find the container with id 912dd16a6a3825c44329d87221d65b368827264802bb71758a69e52c218c75e8
Jul 28 19:47:28.781609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:28.781585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:28.781749 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:28.781641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:28.781749 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:28.781716    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 19:47:28.781850 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:28.781785    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:28.781850 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:28.781801    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm podName:95002a34-c9fa-467c-8cfe-93f289f3eb56 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:30.781777497 +0000 UTC m=+42.150914604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9swpc" (UID: "95002a34-c9fa-467c-8cfe-93f289f3eb56") : configmap "kube-rbac-proxy" not found
Jul 28 19:47:28.781850 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:28.781849    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls podName:95002a34-c9fa-467c-8cfe-93f289f3eb56 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:30.7818383 +0000 UTC m=+42.150975388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9swpc" (UID: "95002a34-c9fa-467c-8cfe-93f289f3eb56") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:29.285548 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.285330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:29.285785 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.285569    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:29.285785 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:29.285487    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:47:29.285785 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:29.285664    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls podName:8b2a401b-408e-4a7d-950c-439b1fe45b2b nodeName:}" failed. No retries permitted until 2026-07-28 19:47:33.285647621 +0000 UTC m=+44.654784709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls") pod "dns-default-c6qcg" (UID: "8b2a401b-408e-4a7d-950c-439b1fe45b2b") : secret "dns-default-metrics-tls" not found
Jul 28 19:47:29.285785 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:29.285728    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:47:29.285785 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:29.285742    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f7b6555bf-w6jwc: secret "image-registry-tls" not found
Jul 28 19:47:29.285968 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:29.285797    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls podName:1d192865-41b1-448f-9a36-3cbc0ef0f3dd nodeName:}" failed. No retries permitted until 2026-07-28 19:47:33.285780942 +0000 UTC m=+44.654918030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls") pod "image-registry-f7b6555bf-w6jwc" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd") : secret "image-registry-tls" not found
Jul 28 19:47:29.305641 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.305575    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-ltstr"]
Jul 28 19:47:29.319871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.319835    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-ltstr"]
Jul 28 19:47:29.320081 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.319962    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.322730 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.322701    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 19:47:29.323955 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.323662    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 19:47:29.323955 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.323699    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fxqrs\""
Jul 28 19:47:29.323955 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.323699    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 19:47:29.323955 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.323726    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 19:47:29.442210 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.442153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd" event={"ID":"828d02b5-014c-4a4e-9e85-70d4ff4bf722","Type":"ContainerStarted","Data":"912dd16a6a3825c44329d87221d65b368827264802bb71758a69e52c218c75e8"}
Jul 28 19:47:29.443951 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.443915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pzgh8" event={"ID":"13d39a56-8c65-4078-8c72-800f55399d95","Type":"ContainerStarted","Data":"88614e5e3b29f12deccf30fdb9c4541df6055c66e35a84594ced8a6559cee0a8"}
Jul 28 19:47:29.462367 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.462316    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pzgh8" podStartSLOduration=1.6893754730000001 podStartE2EDuration="4.462297631s" totalImagesPullingTime="2.772922158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:29.46197418 +0000 UTC m=+40.831111302" watchObservedRunningTime="2026-07-28 19:47:29.462297631 +0000 UTC m=+40.831434740"
Jul 28 19:47:29.487400 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.487368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d7139cb3-5237-490b-92ae-96a9719c9378-signing-key\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.487584 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.487413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lctn2\" (UniqueName: \"kubernetes.io/projected/d7139cb3-5237-490b-92ae-96a9719c9378-kube-api-access-lctn2\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.487584 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.487440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d7139cb3-5237-490b-92ae-96a9719c9378-signing-cabundle\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.588233 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.588114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d7139cb3-5237-490b-92ae-96a9719c9378-signing-key\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.588233 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.588194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lctn2\" (UniqueName: \"kubernetes.io/projected/d7139cb3-5237-490b-92ae-96a9719c9378-kube-api-access-lctn2\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.588233 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.588220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d7139cb3-5237-490b-92ae-96a9719c9378-signing-cabundle\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.589285 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.589259    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d7139cb3-5237-490b-92ae-96a9719c9378-signing-cabundle\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.591903 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.591873    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d7139cb3-5237-490b-92ae-96a9719c9378-signing-key\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.596306 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.596275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lctn2\" (UniqueName: \"kubernetes.io/projected/d7139cb3-5237-490b-92ae-96a9719c9378-kube-api-access-lctn2\") pod \"service-ca-658d7b7c78-ltstr\" (UID: \"d7139cb3-5237-490b-92ae-96a9719c9378\") " pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.632119 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.632077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-ltstr"
Jul 28 19:47:29.790673 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.790637    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-ltstr"]
Jul 28 19:47:29.828186 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:29.828149    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w64pz_10cc32c5-1a06-42fe-81c0-a1f8b942496b/node-ca/0.log"
Jul 28 19:47:30.039805 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:30.039771    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7139cb3_5237_490b_92ae_96a9719c9378.slice/crio-8d1f65e2257d1bc5b236da4d00683372e35782091bea1bfeb71866b4e236e9fb WatchSource:0}: Error finding container 8d1f65e2257d1bc5b236da4d00683372e35782091bea1bfeb71866b4e236e9fb: Status 404 returned error can't find the container with id 8d1f65e2257d1bc5b236da4d00683372e35782091bea1bfeb71866b4e236e9fb
Jul 28 19:47:30.428466 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:30.428440    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pzgh8_13d39a56-8c65-4078-8c72-800f55399d95/serve-healthcheck-canary/0.log"
Jul 28 19:47:30.447152 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:30.447117    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-ltstr" event={"ID":"d7139cb3-5237-490b-92ae-96a9719c9378","Type":"ContainerStarted","Data":"8d1f65e2257d1bc5b236da4d00683372e35782091bea1bfeb71866b4e236e9fb"}
Jul 28 19:47:30.796960 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:30.796925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:30.797151 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:30.797026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:30.797151 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:30.797094    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:30.797300 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:30.797194    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls podName:95002a34-c9fa-467c-8cfe-93f289f3eb56 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:34.797147395 +0000 UTC m=+46.166284485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9swpc" (UID: "95002a34-c9fa-467c-8cfe-93f289f3eb56") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:30.797579 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:30.797546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/95002a34-c9fa-467c-8cfe-93f289f3eb56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:31.452060 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:31.452016    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd" event={"ID":"828d02b5-014c-4a4e-9e85-70d4ff4bf722","Type":"ContainerStarted","Data":"abfb13b9edf05e41b14300feb4bca0c54c30842f0566fbc5cacf66cc4c1902d5"}
Jul 28 19:47:31.452631 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:31.452089    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd" event={"ID":"828d02b5-014c-4a4e-9e85-70d4ff4bf722","Type":"ContainerStarted","Data":"175a1482110d2d9e0c7ad4c80771b616e6de551c267ef5bd6839dc2c9cb36d33"}
Jul 28 19:47:31.468226 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:31.468153    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-87wrd" podStartSLOduration=2.7839688259999997 podStartE2EDuration="4.468133135s" totalImagesPullingTime="1.684164309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:31.467623031 +0000 UTC m=+42.836760141" watchObservedRunningTime="2026-07-28 19:47:31.468133135 +0000 UTC m=+42.837270246"
Jul 28 19:47:33.316342 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:33.316305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:33.316342 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:33.316354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:33.316833 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:33.316487    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 19:47:33.316833 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:33.316516    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 19:47:33.316833 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:33.316531    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f7b6555bf-w6jwc: secret "image-registry-tls" not found
Jul 28 19:47:33.316833 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:33.316570    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls podName:8b2a401b-408e-4a7d-950c-439b1fe45b2b nodeName:}" failed. No retries permitted until 2026-07-28 19:47:41.316548905 +0000 UTC m=+52.685686001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls") pod "dns-default-c6qcg" (UID: "8b2a401b-408e-4a7d-950c-439b1fe45b2b") : secret "dns-default-metrics-tls" not found
Jul 28 19:47:33.316833 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:33.316590    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls podName:1d192865-41b1-448f-9a36-3cbc0ef0f3dd nodeName:}" failed. No retries permitted until 2026-07-28 19:47:41.316580227 +0000 UTC m=+52.685717320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls") pod "image-registry-f7b6555bf-w6jwc" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd") : secret "image-registry-tls" not found
Jul 28 19:47:33.458248 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:33.458213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-ltstr" event={"ID":"d7139cb3-5237-490b-92ae-96a9719c9378","Type":"ContainerStarted","Data":"0d5f3f1c15c7a68712e69232703c88c56253a8d15683bdfa53bf23696c019202"}
Jul 28 19:47:33.472634 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:33.472573    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-ltstr" podStartSLOduration=2.036947873 podStartE2EDuration="4.472556642s" totalImagesPullingTime="2.435608769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:33.47201609 +0000 UTC m=+44.841153201" watchObservedRunningTime="2026-07-28 19:47:33.472556642 +0000 UTC m=+44.841693816"
Jul 28 19:47:34.829894 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:34.829852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:34.830408 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:34.830026    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:34.830408 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:47:34.830111    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls podName:95002a34-c9fa-467c-8cfe-93f289f3eb56 nodeName:}" failed. No retries permitted until 2026-07-28 19:47:42.830090016 +0000 UTC m=+54.199227105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9swpc" (UID: "95002a34-c9fa-467c-8cfe-93f289f3eb56") : secret "insights-runtime-extractor-tls" not found
Jul 28 19:47:41.381917 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:41.381880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:41.381917 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:41.381921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:41.384812 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:41.384789    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b2a401b-408e-4a7d-950c-439b1fe45b2b-metrics-tls\") pod \"dns-default-c6qcg\" (UID: \"8b2a401b-408e-4a7d-950c-439b1fe45b2b\") " pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:41.384941 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:41.384919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"image-registry-f7b6555bf-w6jwc\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") " pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:41.392774 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:41.392746    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:41.404978 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:41.404942    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:41.545676 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:41.545650    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f7b6555bf-w6jwc"]
Jul 28 19:47:41.548156 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:41.548125    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d192865_41b1_448f_9a36_3cbc0ef0f3dd.slice/crio-c95a62b5bd17cc278dddd57338b588855c589ad37628335d540757fe4a2d882f WatchSource:0}: Error finding container c95a62b5bd17cc278dddd57338b588855c589ad37628335d540757fe4a2d882f: Status 404 returned error can't find the container with id c95a62b5bd17cc278dddd57338b588855c589ad37628335d540757fe4a2d882f
Jul 28 19:47:41.568421 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:41.568386    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c6qcg"]
Jul 28 19:47:41.572043 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:41.572008    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2a401b_408e_4a7d_950c_439b1fe45b2b.slice/crio-e8a206684e3503c630bf7bb1052876a07f696dac4064aaedd6b827548106bd91 WatchSource:0}: Error finding container e8a206684e3503c630bf7bb1052876a07f696dac4064aaedd6b827548106bd91: Status 404 returned error can't find the container with id e8a206684e3503c630bf7bb1052876a07f696dac4064aaedd6b827548106bd91
Jul 28 19:47:42.484084 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:42.484041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc" event={"ID":"1d192865-41b1-448f-9a36-3cbc0ef0f3dd","Type":"ContainerStarted","Data":"a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3"}
Jul 28 19:47:42.484587 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:42.484098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc" event={"ID":"1d192865-41b1-448f-9a36-3cbc0ef0f3dd","Type":"ContainerStarted","Data":"c95a62b5bd17cc278dddd57338b588855c589ad37628335d540757fe4a2d882f"}
Jul 28 19:47:42.484587 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:42.484149    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:47:42.485446 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:42.485412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c6qcg" event={"ID":"8b2a401b-408e-4a7d-950c-439b1fe45b2b","Type":"ContainerStarted","Data":"e8a206684e3503c630bf7bb1052876a07f696dac4064aaedd6b827548106bd91"}
Jul 28 19:47:42.506059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:42.506006    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc" podStartSLOduration=24.505987482 podStartE2EDuration="24.505987482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:42.504933007 +0000 UTC m=+53.874070118" watchObservedRunningTime="2026-07-28 19:47:42.505987482 +0000 UTC m=+53.875124569"
Jul 28 19:47:42.896437 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:42.896277    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:42.899323 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:42.899291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/95002a34-c9fa-467c-8cfe-93f289f3eb56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9swpc\" (UID: \"95002a34-c9fa-467c-8cfe-93f289f3eb56\") " pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:42.939252 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:42.939209    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9swpc"
Jul 28 19:47:43.092490 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:43.092461    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9swpc"]
Jul 28 19:47:43.466930 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:43.466894    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95002a34_c9fa_467c_8cfe_93f289f3eb56.slice/crio-3ac1a1030498019c61346a2d6b052603c0823f47b60adf9b0e17bfb9a883eba2 WatchSource:0}: Error finding container 3ac1a1030498019c61346a2d6b052603c0823f47b60adf9b0e17bfb9a883eba2: Status 404 returned error can't find the container with id 3ac1a1030498019c61346a2d6b052603c0823f47b60adf9b0e17bfb9a883eba2
Jul 28 19:47:43.489694 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:43.489647    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9swpc" event={"ID":"95002a34-c9fa-467c-8cfe-93f289f3eb56","Type":"ContainerStarted","Data":"3ac1a1030498019c61346a2d6b052603c0823f47b60adf9b0e17bfb9a883eba2"}
Jul 28 19:47:44.495840 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:44.495794    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c6qcg" event={"ID":"8b2a401b-408e-4a7d-950c-439b1fe45b2b","Type":"ContainerStarted","Data":"cd313984d95c0381ec91c30dd83c73c7730d7a1f36c3f4b928ef15652679a1eb"}
Jul 28 19:47:44.496322 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:44.495853    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c6qcg" event={"ID":"8b2a401b-408e-4a7d-950c-439b1fe45b2b","Type":"ContainerStarted","Data":"d4f45970cb25182b862d6ae588dcb1e83c620c4ee137c856bb8a8f489ab0a815"}
Jul 28 19:47:44.496322 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:44.495934    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:44.513517 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:44.513463    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c6qcg" podStartSLOduration=17.592348292 podStartE2EDuration="19.513447345s" totalImagesPullingTime="1.921099053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:44.512048194 +0000 UTC m=+55.881185306" watchObservedRunningTime="2026-07-28 19:47:44.513447345 +0000 UTC m=+55.882584456"
Jul 28 19:47:48.511616 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:48.511580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9swpc" event={"ID":"95002a34-c9fa-467c-8cfe-93f289f3eb56","Type":"ContainerStarted","Data":"f38a63ec9fc09bcd1be6e0d470e29c786a78b6c50953f20680bb5b53c89beb8c"}
Jul 28 19:47:50.413863 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:50.413836    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gw84m"
Jul 28 19:47:52.526626 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.526590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9swpc" event={"ID":"95002a34-c9fa-467c-8cfe-93f289f3eb56","Type":"ContainerStarted","Data":"66f6cf20d7b3afedd8edc72f90d9b21747318142a63d314910875c53e4fc1d05"}
Jul 28 19:47:52.782915 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.782836    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"]
Jul 28 19:47:52.784994 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.784968    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"
Jul 28 19:47:52.786497 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.786473    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"]
Jul 28 19:47:52.788375 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.788358    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.789020 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.788979    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 19:47:52.789123 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.789026    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 19:47:52.789123 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.789073    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-x84dq\""
Jul 28 19:47:52.789260 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.789138    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 19:47:52.789350 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.789333    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 19:47:52.790787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.790687    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 19:47:52.790955 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.790939    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 19:47:52.791386 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.791359    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 19:47:52.791711 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.791686    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 19:47:52.797474 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.797447    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"]
Jul 28 19:47:52.802959 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.802931    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"]
Jul 28 19:47:52.841044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.841000    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f7b6555bf-w6jwc"]
Jul 28 19:47:52.872467 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.872433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbc858768-srcwk\" (UID: \"01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"
Jul 28 19:47:52.872661 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.872477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbzvk\" (UniqueName: \"kubernetes.io/projected/01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9-kube-api-access-pbzvk\") pod \"managed-serviceaccount-addon-agent-5dbc858768-srcwk\" (UID: \"01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"
Jul 28 19:47:52.872661 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.872506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.872661 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.872625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.872830 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.872663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-ca\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.872830 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.872804    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.872922 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.872833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-hub\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.872922 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.872870    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx4bc\" (UniqueName: \"kubernetes.io/projected/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-kube-api-access-mx4bc\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.893363 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.893327    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b9785d688-fr2pt"]
Jul 28 19:47:52.895698 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.895670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.915030 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.914999    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b9785d688-fr2pt"]
Jul 28 19:47:52.973642 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/539a6f8b-19ef-475c-8222-7446d2b343b2-trusted-ca\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.973642 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-hub\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.973907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx4bc\" (UniqueName: \"kubernetes.io/projected/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-kube-api-access-mx4bc\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.973907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/539a6f8b-19ef-475c-8222-7446d2b343b2-installation-pull-secrets\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.973907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-registry-tls\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.973907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbc858768-srcwk\" (UID: \"01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"
Jul 28 19:47:52.973907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/539a6f8b-19ef-475c-8222-7446d2b343b2-ca-trust-extracted\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.973907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbzvk\" (UniqueName: \"kubernetes.io/projected/01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9-kube-api-access-pbzvk\") pod \"managed-serviceaccount-addon-agent-5dbc858768-srcwk\" (UID: \"01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"
Jul 28 19:47:52.973907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/539a6f8b-19ef-475c-8222-7446d2b343b2-registry-certificates\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.974442 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.974442 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.974442 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.973990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-ca\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.974442 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.974040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/539a6f8b-19ef-475c-8222-7446d2b343b2-image-registry-private-configuration\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.974442 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.974079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-bound-sa-token\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.974442 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.974108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzb4w\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-kube-api-access-tzb4w\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:52.974442 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.974321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.975285 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.975158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.977072 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.977049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-ca\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.977214 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.977154    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-hub\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.977765 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.977726    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5dbc858768-srcwk\" (UID: \"01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"
Jul 28 19:47:52.977860 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.977826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.977962 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.977939    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.985549 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.985528    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx4bc\" (UniqueName: \"kubernetes.io/projected/96aee7f1-7e12-4f49-ab70-6e7217fa3e4b-kube-api-access-mx4bc\") pod \"cluster-proxy-proxy-agent-6d89f57cc9-2nb9k\" (UID: \"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:52.985786 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:52.985767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbzvk\" (UniqueName: \"kubernetes.io/projected/01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9-kube-api-access-pbzvk\") pod \"managed-serviceaccount-addon-agent-5dbc858768-srcwk\" (UID: \"01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"
Jul 28 19:47:53.076287 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/539a6f8b-19ef-475c-8222-7446d2b343b2-installation-pull-secrets\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.076287 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-registry-tls\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.076287 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/539a6f8b-19ef-475c-8222-7446d2b343b2-ca-trust-extracted\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.076526 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/539a6f8b-19ef-475c-8222-7446d2b343b2-registry-certificates\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.076526 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/539a6f8b-19ef-475c-8222-7446d2b343b2-image-registry-private-configuration\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.076526 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076482    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-bound-sa-token\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.076526 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzb4w\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-kube-api-access-tzb4w\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.076642 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/539a6f8b-19ef-475c-8222-7446d2b343b2-trusted-ca\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.076726 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.076686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/539a6f8b-19ef-475c-8222-7446d2b343b2-ca-trust-extracted\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.077247 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.077220    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/539a6f8b-19ef-475c-8222-7446d2b343b2-registry-certificates\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.077496 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.077411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/539a6f8b-19ef-475c-8222-7446d2b343b2-trusted-ca\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.079232 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.079207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-registry-tls\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.079527 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.079502    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/539a6f8b-19ef-475c-8222-7446d2b343b2-image-registry-private-configuration\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.079527 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.079517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/539a6f8b-19ef-475c-8222-7446d2b343b2-installation-pull-secrets\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.095738 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.095706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzb4w\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-kube-api-access-tzb4w\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.102700 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.102672    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/539a6f8b-19ef-475c-8222-7446d2b343b2-bound-sa-token\") pod \"image-registry-7b9785d688-fr2pt\" (UID: \"539a6f8b-19ef-475c-8222-7446d2b343b2\") " pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.107591 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.107553    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"
Jul 28 19:47:53.113508 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.113476    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"
Jul 28 19:47:53.222047 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.222009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.270561 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.270528    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk"]
Jul 28 19:47:53.274144 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:53.273941    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01a7e593_c1a6_4e8c_9eaa_e5213a96a8b9.slice/crio-403ef59b2a1ec359f1646d4e2a6fdfcc795d7176435dddbe2ab19140e1711c9a WatchSource:0}: Error finding container 403ef59b2a1ec359f1646d4e2a6fdfcc795d7176435dddbe2ab19140e1711c9a: Status 404 returned error can't find the container with id 403ef59b2a1ec359f1646d4e2a6fdfcc795d7176435dddbe2ab19140e1711c9a
Jul 28 19:47:53.291553 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.291504    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k"]
Jul 28 19:47:53.297377 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:53.297326    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96aee7f1_7e12_4f49_ab70_6e7217fa3e4b.slice/crio-ce39cc15251c82955df24606b7cc13ddae8689d0b88f82c806c94527da7caa6c WatchSource:0}: Error finding container ce39cc15251c82955df24606b7cc13ddae8689d0b88f82c806c94527da7caa6c: Status 404 returned error can't find the container with id ce39cc15251c82955df24606b7cc13ddae8689d0b88f82c806c94527da7caa6c
Jul 28 19:47:53.388534 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.388499    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b9785d688-fr2pt"]
Jul 28 19:47:53.392886 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:53.392841    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539a6f8b_19ef_475c_8222_7446d2b343b2.slice/crio-802ab1c8ffa563d140d019495953a41f7bd6e1f82c87c7b9b41d3edd2c77526c WatchSource:0}: Error finding container 802ab1c8ffa563d140d019495953a41f7bd6e1f82c87c7b9b41d3edd2c77526c: Status 404 returned error can't find the container with id 802ab1c8ffa563d140d019495953a41f7bd6e1f82c87c7b9b41d3edd2c77526c
Jul 28 19:47:53.532759 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.532722    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b9785d688-fr2pt" event={"ID":"539a6f8b-19ef-475c-8222-7446d2b343b2","Type":"ContainerStarted","Data":"5284f92a28e37dc7a52001089d9828e245784cf347d05771a7f332f7340c6209"}
Jul 28 19:47:53.533244 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.532783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b9785d688-fr2pt" event={"ID":"539a6f8b-19ef-475c-8222-7446d2b343b2","Type":"ContainerStarted","Data":"802ab1c8ffa563d140d019495953a41f7bd6e1f82c87c7b9b41d3edd2c77526c"}
Jul 28 19:47:53.533244 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.532847    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:47:53.534216 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.534148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k" event={"ID":"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b","Type":"ContainerStarted","Data":"ce39cc15251c82955df24606b7cc13ddae8689d0b88f82c806c94527da7caa6c"}
Jul 28 19:47:53.535480 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.535451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk" event={"ID":"01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9","Type":"ContainerStarted","Data":"403ef59b2a1ec359f1646d4e2a6fdfcc795d7176435dddbe2ab19140e1711c9a"}
Jul 28 19:47:53.551719 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:53.551645    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b9785d688-fr2pt" podStartSLOduration=1.5516208009999999 podStartE2EDuration="1.551620801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:53.550309018 +0000 UTC m=+64.919446128" watchObservedRunningTime="2026-07-28 19:47:53.551620801 +0000 UTC m=+64.920757912"
Jul 28 19:47:54.502705 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:54.502672    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c6qcg"
Jul 28 19:47:54.893811 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:54.893718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:54.896422 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:54.896392    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 19:47:54.912592 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:54.912555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a91e882c-0d84-4ca9-8604-c74345b460b4-metrics-certs\") pod \"network-metrics-daemon-mn7vj\" (UID: \"a91e882c-0d84-4ca9-8604-c74345b460b4\") " pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:54.995479 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:54.994824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:54.995479 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:54.994905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:54.998027 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:54.997627    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 19:47:54.998027 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:54.997867    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 19:47:55.008469 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:55.008446    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 19:47:55.009622 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:55.009586    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29481a0e-8d07-408c-8ab4-69b8db682394-original-pull-secret\") pod \"global-pull-secret-syncer-5fgtz\" (UID: \"29481a0e-8d07-408c-8ab4-69b8db682394\") " pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:55.027331 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:55.027255    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjcqq\" (UniqueName: \"kubernetes.io/projected/5ccb39dc-8233-45ee-9dc7-f3befceb92e1-kube-api-access-cjcqq\") pod \"network-check-target-hjst7\" (UID: \"5ccb39dc-8233-45ee-9dc7-f3befceb92e1\") " pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:55.066934 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:55.066735    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lhtrs\""
Jul 28 19:47:55.070447 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:55.070254    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l4wgt\""
Jul 28 19:47:55.075480 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:55.075161    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:47:55.078926 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:55.078876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mn7vj"
Jul 28 19:47:55.167959 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:55.167874    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5fgtz"
Jul 28 19:47:59.167185 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.167122    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hjst7"]
Jul 28 19:47:59.171322 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:59.171240    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccb39dc_8233_45ee_9dc7_f3befceb92e1.slice/crio-1d9eb93f9044c1f04d0eaa471559430a315b0fcf2772e970da282be5e13b95d4 WatchSource:0}: Error finding container 1d9eb93f9044c1f04d0eaa471559430a315b0fcf2772e970da282be5e13b95d4: Status 404 returned error can't find the container with id 1d9eb93f9044c1f04d0eaa471559430a315b0fcf2772e970da282be5e13b95d4
Jul 28 19:47:59.193078 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.193049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mn7vj"]
Jul 28 19:47:59.221331 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.221301    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5fgtz"]
Jul 28 19:47:59.224901 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:47:59.224878    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29481a0e_8d07_408c_8ab4_69b8db682394.slice/crio-50fb6ee235736858f4dfb49b0d8269e1694c73980538ffb26b160eb2f0d90325 WatchSource:0}: Error finding container 50fb6ee235736858f4dfb49b0d8269e1694c73980538ffb26b160eb2f0d90325: Status 404 returned error can't find the container with id 50fb6ee235736858f4dfb49b0d8269e1694c73980538ffb26b160eb2f0d90325
Jul 28 19:47:59.559190 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.559069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hjst7" event={"ID":"5ccb39dc-8233-45ee-9dc7-f3befceb92e1","Type":"ContainerStarted","Data":"1d9eb93f9044c1f04d0eaa471559430a315b0fcf2772e970da282be5e13b95d4"}
Jul 28 19:47:59.561148 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.561121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9swpc" event={"ID":"95002a34-c9fa-467c-8cfe-93f289f3eb56","Type":"ContainerStarted","Data":"9aa89c79e35076749e00868f74c3c76ec8cafef229c713b6bc7b8e547803c0a1"}
Jul 28 19:47:59.563091 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.563069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k" event={"ID":"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b","Type":"ContainerStarted","Data":"1e7c2097d7af6c9436e1fbe76b096db8bb257ca22fd4498dd2f834f4aeb8e931"}
Jul 28 19:47:59.563211 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.563102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k" event={"ID":"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b","Type":"ContainerStarted","Data":"3f6dc7dc9a7a68dbb55c7e8de705cee7bc775455aaafad33cb83ffd4cbcb3dda"}
Jul 28 19:47:59.563211 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.563118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k" event={"ID":"96aee7f1-7e12-4f49-ab70-6e7217fa3e4b","Type":"ContainerStarted","Data":"d58c74f344d1949c9297f589f8aa10ee551dc769131cf445e6c43c5fcdd6e831"}
Jul 28 19:47:59.564618 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.564581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk" event={"ID":"01a7e593-c1a6-4e8c-9eaa-e5213a96a8b9","Type":"ContainerStarted","Data":"dc90ac858817028e2387c9a8ea4cdb84fee53ad378a747e88df284e114ece670"}
Jul 28 19:47:59.565740 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.565719    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5fgtz" event={"ID":"29481a0e-8d07-408c-8ab4-69b8db682394","Type":"ContainerStarted","Data":"50fb6ee235736858f4dfb49b0d8269e1694c73980538ffb26b160eb2f0d90325"}
Jul 28 19:47:59.566776 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.566756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mn7vj" event={"ID":"a91e882c-0d84-4ca9-8604-c74345b460b4","Type":"ContainerStarted","Data":"7588ae1925350cd4df5a7c8a773ec9b27f46585e5560655918b5e423a6adf4a5"}
Jul 28 19:47:59.578627 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.578579    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9swpc" podStartSLOduration=18.203373502 podStartE2EDuration="33.578561841s" totalImagesPullingTime="15.375188339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:47:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:59.577333548 +0000 UTC m=+70.946470671" watchObservedRunningTime="2026-07-28 19:47:59.578561841 +0000 UTC m=+70.947698948"
Jul 28 19:47:59.592418 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.592367    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5dbc858768-srcwk" podStartSLOduration=1.8724210019999998 podStartE2EDuration="7.592349046s" totalImagesPullingTime="5.719928044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:59.591840996 +0000 UTC m=+70.960978118" watchObservedRunningTime="2026-07-28 19:47:59.592349046 +0000 UTC m=+70.961486157"
Jul 28 19:47:59.609064 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:47:59.609010    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d89f57cc9-2nb9k" podStartSLOduration=1.9046176190000002 podStartE2EDuration="7.608991129s" totalImagesPullingTime="5.70437351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:59.608636159 +0000 UTC m=+70.977773270" watchObservedRunningTime="2026-07-28 19:47:59.608991129 +0000 UTC m=+70.978128238"
Jul 28 19:48:00.576015 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:00.575930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mn7vj" event={"ID":"a91e882c-0d84-4ca9-8604-c74345b460b4","Type":"ContainerStarted","Data":"c693f9b1f7040517ac28e060b80aa26833bc090926a4b0d367dc17ecae6ea051"}
Jul 28 19:48:00.576456 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:00.576035    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mn7vj" event={"ID":"a91e882c-0d84-4ca9-8604-c74345b460b4","Type":"ContainerStarted","Data":"69d58851d7ab13b0df49c09a31e2b22fd8d9520dc7aed09b4e65fad068dd51e1"}
Jul 28 19:48:00.592248 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:00.591389    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mn7vj" podStartSLOduration=69.48932955 podStartE2EDuration="1m10.59136614s" totalImagesPullingTime="1.10203659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:48:00.590043512 +0000 UTC m=+71.959180621" watchObservedRunningTime="2026-07-28 19:48:00.59136614 +0000 UTC m=+71.960503251"
Jul 28 19:48:02.847155 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:02.847121    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:48:04.594611 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:04.594579    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5fgtz" event={"ID":"29481a0e-8d07-408c-8ab4-69b8db682394","Type":"ContainerStarted","Data":"d32c76c2cf20de787190a8e931731c12042c0eb32a9ee0617595d08621e0adce"}
Jul 28 19:48:04.596089 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:04.596063    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hjst7" event={"ID":"5ccb39dc-8233-45ee-9dc7-f3befceb92e1","Type":"ContainerStarted","Data":"04960cfa0bcc23ddc40db074146415e58a39546672c0cf64f920904af2489041"}
Jul 28 19:48:04.596226 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:04.596214    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:48:04.613474 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:04.613423    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5fgtz" podStartSLOduration=69.697707112 podStartE2EDuration="1m14.613408027s" totalImagesPullingTime="4.915700915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:48:04.613384823 +0000 UTC m=+75.982521934" watchObservedRunningTime="2026-07-28 19:48:04.613408027 +0000 UTC m=+75.982545137"
Jul 28 19:48:04.629541 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:04.629483    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hjst7" podStartSLOduration=70.031023199 podStartE2EDuration="1m14.629467443s" totalImagesPullingTime="4.598444244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:48:04.62849027 +0000 UTC m=+75.997627395" watchObservedRunningTime="2026-07-28 19:48:04.629467443 +0000 UTC m=+75.998604596"
Jul 28 19:48:11.562325 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.562190    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tbh56"]
Jul 28 19:48:11.564966 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.564943    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.567697 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.567662    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 19:48:11.567697 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.567677    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 19:48:11.567872 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.567750    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 19:48:11.567872 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.567788    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lrswp\""
Jul 28 19:48:11.567872 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.567867    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 19:48:11.568027 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.567926    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 19:48:11.568630 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.568615    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 19:48:11.633371 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633330    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-textfile\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.633561 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-wtmp\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.633561 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633408    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-root\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.633561 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-accelerators-collector-config\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.633561 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633535    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d833780-bf13-42b7-8e1f-f2498fe9cacb-metrics-client-ca\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.633769 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-sys\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.633769 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.633769 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nskzx\" (UniqueName: \"kubernetes.io/projected/9d833780-bf13-42b7-8e1f-f2498fe9cacb-kube-api-access-nskzx\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.633769 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.633748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734388 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-textfile\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734388 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734398    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-wtmp\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734660 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734425    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-root\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734660 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-accelerators-collector-config\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734660 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734486    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d833780-bf13-42b7-8e1f-f2498fe9cacb-metrics-client-ca\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734660 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734556    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-root\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734660 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-sys\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734660 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734975 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nskzx\" (UniqueName: \"kubernetes.io/projected/9d833780-bf13-42b7-8e1f-f2498fe9cacb-kube-api-access-nskzx\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734975 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734975 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734781    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-textfile\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734975 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734848    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-sys\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.734975 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.734973    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-wtmp\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.735259 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:48:11.735061    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 19:48:11.735259 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.735104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d833780-bf13-42b7-8e1f-f2498fe9cacb-metrics-client-ca\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.735259 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:48:11.735121    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls podName:9d833780-bf13-42b7-8e1f-f2498fe9cacb nodeName:}" failed. No retries permitted until 2026-07-28 19:48:12.235099869 +0000 UTC m=+83.604236969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls") pod "node-exporter-tbh56" (UID: "9d833780-bf13-42b7-8e1f-f2498fe9cacb") : secret "node-exporter-tls" not found
Jul 28 19:48:11.735259 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.735124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-accelerators-collector-config\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.737503 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.737479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:11.746137 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:11.746105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nskzx\" (UniqueName: \"kubernetes.io/projected/9d833780-bf13-42b7-8e1f-f2498fe9cacb-kube-api-access-nskzx\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:12.238144 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:12.238106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:12.238355 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:48:12.238272    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 19:48:12.238355 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:48:12.238337    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls podName:9d833780-bf13-42b7-8e1f-f2498fe9cacb nodeName:}" failed. No retries permitted until 2026-07-28 19:48:13.238323069 +0000 UTC m=+84.607460158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls") pod "node-exporter-tbh56" (UID: "9d833780-bf13-42b7-8e1f-f2498fe9cacb") : secret "node-exporter-tls" not found
Jul 28 19:48:13.245422 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:13.245376    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:13.247825 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:13.247802    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d833780-bf13-42b7-8e1f-f2498fe9cacb-node-exporter-tls\") pod \"node-exporter-tbh56\" (UID: \"9d833780-bf13-42b7-8e1f-f2498fe9cacb\") " pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:13.374360 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:13.374319    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tbh56"
Jul 28 19:48:13.385398 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:48:13.385367    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d833780_bf13_42b7_8e1f_f2498fe9cacb.slice/crio-66ffdd2a40964d5bce7f74e700297a9819d8533c3470d25d093294692e94dffa WatchSource:0}: Error finding container 66ffdd2a40964d5bce7f74e700297a9819d8533c3470d25d093294692e94dffa: Status 404 returned error can't find the container with id 66ffdd2a40964d5bce7f74e700297a9819d8533c3470d25d093294692e94dffa
Jul 28 19:48:13.630387 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:13.630303    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tbh56" event={"ID":"9d833780-bf13-42b7-8e1f-f2498fe9cacb","Type":"ContainerStarted","Data":"66ffdd2a40964d5bce7f74e700297a9819d8533c3470d25d093294692e94dffa"}
Jul 28 19:48:14.545209 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:14.545157    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b9785d688-fr2pt"
Jul 28 19:48:14.636194 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:14.636142    2575 generic.go:356] "Generic (PLEG): container finished" podID="9d833780-bf13-42b7-8e1f-f2498fe9cacb" containerID="4fba80f46e3540f0aae66da818b5618f8b9a2a75cb990a1cf17ecc5e26e4f5a6" exitCode=0
Jul 28 19:48:14.636369 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:14.636235    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tbh56" event={"ID":"9d833780-bf13-42b7-8e1f-f2498fe9cacb","Type":"ContainerDied","Data":"4fba80f46e3540f0aae66da818b5618f8b9a2a75cb990a1cf17ecc5e26e4f5a6"}
Jul 28 19:48:15.642220 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:15.642154    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tbh56" event={"ID":"9d833780-bf13-42b7-8e1f-f2498fe9cacb","Type":"ContainerStarted","Data":"96656fc02926afc3f6fea1925a84c636061cde1e4c732435ad79fff98c9bbfaf"}
Jul 28 19:48:15.642608 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:15.642271    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tbh56" event={"ID":"9d833780-bf13-42b7-8e1f-f2498fe9cacb","Type":"ContainerStarted","Data":"fb4971167d790834cb6241f7de3007521f5c440bb97d26c3700a1c3e00520528"}
Jul 28 19:48:15.662841 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:15.662790    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tbh56" podStartSLOduration=3.776598619 podStartE2EDuration="4.662774892s" totalImagesPullingTime="812.326598ms" totalInitContainerRuntime="73.849675ms" isStatefulPod=true podCreationTimestamp="2026-07-28 19:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:48:15.662305516 +0000 UTC m=+87.031442625" watchObservedRunningTime="2026-07-28 19:48:15.662774892 +0000 UTC m=+87.031912002"
Jul 28 19:48:17.863960 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:17.863884    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc" podUID="1d192865-41b1-448f-9a36-3cbc0ef0f3dd" containerName="registry" containerID="cri-o://a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3" gracePeriod=30
Jul 28 19:48:18.101728 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.101705    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:48:18.189280 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189183    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5xvg\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-kube-api-access-d5xvg\") pod \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") "
Jul 28 19:48:18.189280 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189254    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-image-registry-private-configuration\") pod \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") "
Jul 28 19:48:18.189504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-certificates\") pod \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") "
Jul 28 19:48:18.189504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189310    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-trusted-ca\") pod \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") "
Jul 28 19:48:18.189504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189327    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-bound-sa-token\") pod \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") "
Jul 28 19:48:18.189504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189382    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-ca-trust-extracted\") pod \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") "
Jul 28 19:48:18.189504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189398    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-installation-pull-secrets\") pod \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") "
Jul 28 19:48:18.189504 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189424    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") pod \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\" (UID: \"1d192865-41b1-448f-9a36-3cbc0ef0f3dd\") "
Jul 28 19:48:18.189851 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189815    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1d192865-41b1-448f-9a36-3cbc0ef0f3dd" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:48:18.189911 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.189827    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1d192865-41b1-448f-9a36-3cbc0ef0f3dd" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:48:18.192014 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.191977    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-kube-api-access-d5xvg" (OuterVolumeSpecName: "kube-api-access-d5xvg") pod "1d192865-41b1-448f-9a36-3cbc0ef0f3dd" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd"). InnerVolumeSpecName "kube-api-access-d5xvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:48:18.192186 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.192135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1d192865-41b1-448f-9a36-3cbc0ef0f3dd" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:48:18.192341 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.192313    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1d192865-41b1-448f-9a36-3cbc0ef0f3dd" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:48:18.192432 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.192368    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1d192865-41b1-448f-9a36-3cbc0ef0f3dd" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:48:18.192432 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.192384    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1d192865-41b1-448f-9a36-3cbc0ef0f3dd" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:48:18.200454 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.200419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1d192865-41b1-448f-9a36-3cbc0ef0f3dd" (UID: "1d192865-41b1-448f-9a36-3cbc0ef0f3dd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:48:18.290359 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.290321    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5xvg\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-kube-api-access-d5xvg\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:48:18.290359 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.290352    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-image-registry-private-configuration\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:48:18.290359 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.290363    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-certificates\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:48:18.290592 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.290373    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-trusted-ca\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:48:18.290592 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.290381    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-bound-sa-token\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:48:18.290592 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.290389    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-ca-trust-extracted\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:48:18.290592 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.290397    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-installation-pull-secrets\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:48:18.290592 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.290405    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d192865-41b1-448f-9a36-3cbc0ef0f3dd-registry-tls\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:48:18.653838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.653807    2575 generic.go:356] "Generic (PLEG): container finished" podID="1d192865-41b1-448f-9a36-3cbc0ef0f3dd" containerID="a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3" exitCode=0
Jul 28 19:48:18.653838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.653854    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc"
Jul 28 19:48:18.654059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.653887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc" event={"ID":"1d192865-41b1-448f-9a36-3cbc0ef0f3dd","Type":"ContainerDied","Data":"a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3"}
Jul 28 19:48:18.654059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.653940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f7b6555bf-w6jwc" event={"ID":"1d192865-41b1-448f-9a36-3cbc0ef0f3dd","Type":"ContainerDied","Data":"c95a62b5bd17cc278dddd57338b588855c589ad37628335d540757fe4a2d882f"}
Jul 28 19:48:18.654059 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.653962    2575 scope.go:117] "RemoveContainer" containerID="a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3"
Jul 28 19:48:18.662573 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.662555    2575 scope.go:117] "RemoveContainer" containerID="a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3"
Jul 28 19:48:18.662880 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:48:18.662858    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3\": container with ID starting with a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3 not found: ID does not exist" containerID="a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3"
Jul 28 19:48:18.662950 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.662888    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3"} err="failed to get container status \"a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3\": rpc error: code = NotFound desc = could not find container \"a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3\": container with ID starting with a76d2ee5f0b2323ab36fad3455580afb8b5be3b71936513bb373c0cf92b86ab3 not found: ID does not exist"
Jul 28 19:48:18.677090 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.677056    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f7b6555bf-w6jwc"]
Jul 28 19:48:18.682115 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:18.682092    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f7b6555bf-w6jwc"]
Jul 28 19:48:19.257490 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:19.257459    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d192865-41b1-448f-9a36-3cbc0ef0f3dd" path="/var/lib/kubelet/pods/1d192865-41b1-448f-9a36-3cbc0ef0f3dd/volumes"
Jul 28 19:48:35.601238 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:48:35.601208    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hjst7"
Jul 28 19:50:50.118404 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.118361    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"]
Jul 28 19:50:50.118866 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.118605    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d192865-41b1-448f-9a36-3cbc0ef0f3dd" containerName="registry"
Jul 28 19:50:50.118866 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.118616    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d192865-41b1-448f-9a36-3cbc0ef0f3dd" containerName="registry"
Jul 28 19:50:50.118866 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.118693    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d192865-41b1-448f-9a36-3cbc0ef0f3dd" containerName="registry"
Jul 28 19:50:50.120710 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.120691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"
Jul 28 19:50:50.123394 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.123362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 28 19:50:50.123551 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.123375    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:50:50.123551 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.123375    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-f2d4j\""
Jul 28 19:50:50.132857 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.132818    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"]
Jul 28 19:50:50.248970 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.248941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlhbj\" (UniqueName: \"kubernetes.io/projected/1f1a10f0-8501-4c32-bc68-75676b438809-kube-api-access-zlhbj\") pod \"cert-manager-operator-controller-manager-55c444bf86-frfd5\" (UID: \"1f1a10f0-8501-4c32-bc68-75676b438809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"
Jul 28 19:50:50.249084 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.248981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1a10f0-8501-4c32-bc68-75676b438809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-frfd5\" (UID: \"1f1a10f0-8501-4c32-bc68-75676b438809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"
Jul 28 19:50:50.349450 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.349407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlhbj\" (UniqueName: \"kubernetes.io/projected/1f1a10f0-8501-4c32-bc68-75676b438809-kube-api-access-zlhbj\") pod \"cert-manager-operator-controller-manager-55c444bf86-frfd5\" (UID: \"1f1a10f0-8501-4c32-bc68-75676b438809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"
Jul 28 19:50:50.349581 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.349467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1a10f0-8501-4c32-bc68-75676b438809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-frfd5\" (UID: \"1f1a10f0-8501-4c32-bc68-75676b438809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"
Jul 28 19:50:50.349827 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.349807    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1a10f0-8501-4c32-bc68-75676b438809-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-frfd5\" (UID: \"1f1a10f0-8501-4c32-bc68-75676b438809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"
Jul 28 19:50:50.360339 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.360307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlhbj\" (UniqueName: \"kubernetes.io/projected/1f1a10f0-8501-4c32-bc68-75676b438809-kube-api-access-zlhbj\") pod \"cert-manager-operator-controller-manager-55c444bf86-frfd5\" (UID: \"1f1a10f0-8501-4c32-bc68-75676b438809\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"
Jul 28 19:50:50.431327 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.431269    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"
Jul 28 19:50:50.559060 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:50.559038    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5"]
Jul 28 19:50:50.561801 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:50:50.561776    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1a10f0_8501_4c32_bc68_75676b438809.slice/crio-699c3321a179cbaeaaf5ac8aed520761ff0c09df6f51dfc1ee0b9cf2cf066590 WatchSource:0}: Error finding container 699c3321a179cbaeaaf5ac8aed520761ff0c09df6f51dfc1ee0b9cf2cf066590: Status 404 returned error can't find the container with id 699c3321a179cbaeaaf5ac8aed520761ff0c09df6f51dfc1ee0b9cf2cf066590
Jul 28 19:50:51.162647 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:51.162607    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5" event={"ID":"1f1a10f0-8501-4c32-bc68-75676b438809","Type":"ContainerStarted","Data":"699c3321a179cbaeaaf5ac8aed520761ff0c09df6f51dfc1ee0b9cf2cf066590"}
Jul 28 19:50:54.176185 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:54.176134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5" event={"ID":"1f1a10f0-8501-4c32-bc68-75676b438809","Type":"ContainerStarted","Data":"33a150854037834603cbbee363f3eca33f200c211cb4b206d4aac9fcabd13f42"}
Jul 28 19:50:54.197806 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:50:54.197756    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-frfd5" podStartSLOduration=1.541136196 podStartE2EDuration="4.197740694s" totalImagesPullingTime="2.656604498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:50:54.195744198 +0000 UTC m=+245.564881345" watchObservedRunningTime="2026-07-28 19:50:54.197740694 +0000 UTC m=+245.566877803"
Jul 28 19:51:32.567225 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.567183    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"]
Jul 28 19:51:32.572229 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.572202    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.579713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.579690    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 19:51:32.579856 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.579718    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 19:51:32.579953 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.579936    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 19:51:32.580010 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.579959    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f6pc8\""
Jul 28 19:51:32.580010 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.579936    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 19:51:32.604950 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.604914    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"]
Jul 28 19:51:32.652270 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.652227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n2ht\" (UniqueName: \"kubernetes.io/projected/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-kube-api-access-6n2ht\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.652270 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.652276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.652533 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.652302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-manifests\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.652533 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.652319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-tmp\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.652533 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.652337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.752956 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.752910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-manifests\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.752956 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.752953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-tmp\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.753248 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.752973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.753248 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.753042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n2ht\" (UniqueName: \"kubernetes.io/projected/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-kube-api-access-6n2ht\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.753248 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.753080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.753430 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.753409    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-manifests\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.755596 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.755573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-tmp\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.755743 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.755699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.755864 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.755845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-webhook-cert\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.762399 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.762370    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n2ht\" (UniqueName: \"kubernetes.io/projected/5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1-kube-api-access-6n2ht\") pod \"opendatahub-operator-controller-manager-85967bc8b9-qwvzp\" (UID: \"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1\") " pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:32.882223 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:32.882087    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:33.027602 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:33.027524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"]
Jul 28 19:51:33.030615 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:51:33.030579    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae12ed3_f3c8_4f90_b2f8_f1cc033850b1.slice/crio-66501a96a2e094e56e3802a07c5f7ee462bca29681592ca1a6457283208ee977 WatchSource:0}: Error finding container 66501a96a2e094e56e3802a07c5f7ee462bca29681592ca1a6457283208ee977: Status 404 returned error can't find the container with id 66501a96a2e094e56e3802a07c5f7ee462bca29681592ca1a6457283208ee977
Jul 28 19:51:33.312489 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:33.312458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp" event={"ID":"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1","Type":"ContainerStarted","Data":"66501a96a2e094e56e3802a07c5f7ee462bca29681592ca1a6457283208ee977"}
Jul 28 19:51:36.327377 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:36.327342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp" event={"ID":"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1","Type":"ContainerStarted","Data":"3859c6d7db2a7af76d5d0513655ba449dcbb0a97807465e5560234d6e4b88fb7"}
Jul 28 19:51:38.337664 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:38.337625    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1" containerID="3859c6d7db2a7af76d5d0513655ba449dcbb0a97807465e5560234d6e4b88fb7" exitCode=0
Jul 28 19:51:38.338071 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:38.337699    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp" event={"ID":"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1","Type":"ContainerDied","Data":"3859c6d7db2a7af76d5d0513655ba449dcbb0a97807465e5560234d6e4b88fb7"}
Jul 28 19:51:39.344034 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:39.343992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp" event={"ID":"5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1","Type":"ContainerStarted","Data":"c0d24f7302d57f818a54a75e1b052f82db13bec559cab72e0413524877a33180"}
Jul 28 19:51:39.344573 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:39.344289    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:39.364976 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:39.364915    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp" podStartSLOduration=2.7541962399999997 podStartE2EDuration="7.36489329s" totalImagesPullingTime="3.536692989s" totalInitContainerRuntime="1.074004061s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:51:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:51:39.363705363 +0000 UTC m=+290.732842472" watchObservedRunningTime="2026-07-28 19:51:39.36489329 +0000 UTC m=+290.734030401"
Jul 28 19:51:49.073314 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:49.073285    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 19:51:50.350012 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:50.349982    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85967bc8b9-qwvzp"
Jul 28 19:51:52.409763 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.409727    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"]
Jul 28 19:51:52.412418 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.412401    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.415200 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.415152    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c6ssc\""
Jul 28 19:51:52.415409 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.415398    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 19:51:52.416391 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.416352    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 19:51:52.416391 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.416356    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 19:51:52.416541 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.416362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 19:51:52.429859 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.429827    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"]
Jul 28 19:51:52.513729 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.513691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctb2g\" (UniqueName: \"kubernetes.io/projected/006712fe-6990-4b24-b581-30925a333721-kube-api-access-ctb2g\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.513907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.513759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/006712fe-6990-4b24-b581-30925a333721-tmp\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.513907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.513795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/006712fe-6990-4b24-b581-30925a333721-tls-certs\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.614278 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.614230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/006712fe-6990-4b24-b581-30925a333721-tmp\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.614278 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.614285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/006712fe-6990-4b24-b581-30925a333721-tls-certs\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.614506 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.614326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctb2g\" (UniqueName: \"kubernetes.io/projected/006712fe-6990-4b24-b581-30925a333721-kube-api-access-ctb2g\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.616901 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.616872    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/006712fe-6990-4b24-b581-30925a333721-tmp\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.617180 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.617137    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/006712fe-6990-4b24-b581-30925a333721-tls-certs\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.626958 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.626922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctb2g\" (UniqueName: \"kubernetes.io/projected/006712fe-6990-4b24-b581-30925a333721-kube-api-access-ctb2g\") pod \"kube-auth-proxy-579d8dfb47-nh8bj\" (UID: \"006712fe-6990-4b24-b581-30925a333721\") " pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.721975 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.721879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"
Jul 28 19:51:52.781652 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.781622    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2sht7"]
Jul 28 19:51:52.784140 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.784060    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:52.787354 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.787327    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-krx9w\""
Jul 28 19:51:52.788129 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.788023    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 28 19:51:52.805689 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.805639    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2sht7"]
Jul 28 19:51:52.869294 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.869265    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj"]
Jul 28 19:51:52.871135 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:51:52.871107    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006712fe_6990_4b24_b581_30925a333721.slice/crio-a3a22b6b91d630625f869fb52a581f39270b8e096c46b17e3cc881934be21062 WatchSource:0}: Error finding container a3a22b6b91d630625f869fb52a581f39270b8e096c46b17e3cc881934be21062: Status 404 returned error can't find the container with id a3a22b6b91d630625f869fb52a581f39270b8e096c46b17e3cc881934be21062
Jul 28 19:51:52.873069 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.873055    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:51:52.916530 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.916496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhlzq\" (UniqueName: \"kubernetes.io/projected/615eb736-5a59-470f-81cd-f1182ebe0dec-kube-api-access-zhlzq\") pod \"odh-model-controller-7998c67dc4-2sht7\" (UID: \"615eb736-5a59-470f-81cd-f1182ebe0dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:52.916711 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:52.916570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615eb736-5a59-470f-81cd-f1182ebe0dec-cert\") pod \"odh-model-controller-7998c67dc4-2sht7\" (UID: \"615eb736-5a59-470f-81cd-f1182ebe0dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:53.017406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.017373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615eb736-5a59-470f-81cd-f1182ebe0dec-cert\") pod \"odh-model-controller-7998c67dc4-2sht7\" (UID: \"615eb736-5a59-470f-81cd-f1182ebe0dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:53.017598 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.017425    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhlzq\" (UniqueName: \"kubernetes.io/projected/615eb736-5a59-470f-81cd-f1182ebe0dec-kube-api-access-zhlzq\") pod \"odh-model-controller-7998c67dc4-2sht7\" (UID: \"615eb736-5a59-470f-81cd-f1182ebe0dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:53.017598 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:51:53.017557    2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 28 19:51:53.017681 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:51:53.017636    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615eb736-5a59-470f-81cd-f1182ebe0dec-cert podName:615eb736-5a59-470f-81cd-f1182ebe0dec nodeName:}" failed. No retries permitted until 2026-07-28 19:51:53.517613926 +0000 UTC m=+304.886751029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/615eb736-5a59-470f-81cd-f1182ebe0dec-cert") pod "odh-model-controller-7998c67dc4-2sht7" (UID: "615eb736-5a59-470f-81cd-f1182ebe0dec") : secret "odh-model-controller-webhook-cert" not found
Jul 28 19:51:53.032145 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.032117    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhlzq\" (UniqueName: \"kubernetes.io/projected/615eb736-5a59-470f-81cd-f1182ebe0dec-kube-api-access-zhlzq\") pod \"odh-model-controller-7998c67dc4-2sht7\" (UID: \"615eb736-5a59-470f-81cd-f1182ebe0dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:53.407424 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.407336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj" event={"ID":"006712fe-6990-4b24-b581-30925a333721","Type":"ContainerStarted","Data":"a3a22b6b91d630625f869fb52a581f39270b8e096c46b17e3cc881934be21062"}
Jul 28 19:51:53.521026 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.520982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615eb736-5a59-470f-81cd-f1182ebe0dec-cert\") pod \"odh-model-controller-7998c67dc4-2sht7\" (UID: \"615eb736-5a59-470f-81cd-f1182ebe0dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:53.523645 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.523620    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/615eb736-5a59-470f-81cd-f1182ebe0dec-cert\") pod \"odh-model-controller-7998c67dc4-2sht7\" (UID: \"615eb736-5a59-470f-81cd-f1182ebe0dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:53.666055 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.665971    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qp2jq"]
Jul 28 19:51:53.669836 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.669666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:53.672091 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.672029    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 28 19:51:53.672264 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.672225    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-q4bj2\""
Jul 28 19:51:53.681263 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.681233    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qp2jq"]
Jul 28 19:51:53.698612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.698574    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:53.794122 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.794089    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"]
Jul 28 19:51:53.797975 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.797950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:53.800483 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.800464    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fnbcf\""
Jul 28 19:51:53.800655 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.800638    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 19:51:53.800996 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.800973    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 19:51:53.801223 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.801205    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 19:51:53.801321 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.801208    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 19:51:53.813875 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.812332    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"]
Jul 28 19:51:53.823829 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.823781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6lgp\" (UniqueName: \"kubernetes.io/projected/fd61d2be-22b2-4a75-a5e2-97c2725d7750-kube-api-access-d6lgp\") pod \"model-serving-api-54d89bd5fc-qp2jq\" (UID: \"fd61d2be-22b2-4a75-a5e2-97c2725d7750\") " pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:53.823829 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.823826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd61d2be-22b2-4a75-a5e2-97c2725d7750-tls-certs\") pod \"model-serving-api-54d89bd5fc-qp2jq\" (UID: \"fd61d2be-22b2-4a75-a5e2-97c2725d7750\") " pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:53.867254 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.866845    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2sht7"]
Jul 28 19:51:53.870094 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:51:53.870058    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615eb736_5a59_470f_81cd_f1182ebe0dec.slice/crio-a6631e258c63e4aa677f503dd9066f39dfce2b11af9415426342a8cece90c704 WatchSource:0}: Error finding container a6631e258c63e4aa677f503dd9066f39dfce2b11af9415426342a8cece90c704: Status 404 returned error can't find the container with id a6631e258c63e4aa677f503dd9066f39dfce2b11af9415426342a8cece90c704
Jul 28 19:51:53.925081 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.924997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6lgp\" (UniqueName: \"kubernetes.io/projected/fd61d2be-22b2-4a75-a5e2-97c2725d7750-kube-api-access-d6lgp\") pod \"model-serving-api-54d89bd5fc-qp2jq\" (UID: \"fd61d2be-22b2-4a75-a5e2-97c2725d7750\") " pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:53.925081 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.925046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd61d2be-22b2-4a75-a5e2-97c2725d7750-tls-certs\") pod \"model-serving-api-54d89bd5fc-qp2jq\" (UID: \"fd61d2be-22b2-4a75-a5e2-97c2725d7750\") " pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:53.925360 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.925252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:53.925360 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.925298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4hb9\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-kube-api-access-h4hb9\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:53.925360 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.925342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:53.925491 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.925420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:53.925491 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.925465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:53.925593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.925509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:53.925593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.925533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:53.928160 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.928139    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd61d2be-22b2-4a75-a5e2-97c2725d7750-tls-certs\") pod \"model-serving-api-54d89bd5fc-qp2jq\" (UID: \"fd61d2be-22b2-4a75-a5e2-97c2725d7750\") " pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:53.933986 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.933944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6lgp\" (UniqueName: \"kubernetes.io/projected/fd61d2be-22b2-4a75-a5e2-97c2725d7750-kube-api-access-d6lgp\") pod \"model-serving-api-54d89bd5fc-qp2jq\" (UID: \"fd61d2be-22b2-4a75-a5e2-97c2725d7750\") " pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:53.984041 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:53.983999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:54.026131 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.026081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.026131 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.026137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4hb9\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-kube-api-access-h4hb9\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.026454 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.026191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.026454 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.026239    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.026587 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.026563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.026644 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.026603    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.026644 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.026633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.027309 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.027277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.029201 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.029158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.029616 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.029564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.029616 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.029605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.030065 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.030044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.035264 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.035209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4hb9\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-kube-api-access-h4hb9\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.036769 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.036743    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-sxr8f\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.115780 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.115494    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:51:54.152591 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.152550    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qp2jq"]
Jul 28 19:51:54.156206 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:51:54.156157    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd61d2be_22b2_4a75_a5e2_97c2725d7750.slice/crio-fbbcdee2e21e0e3f7b435ac73e05acf3b47170faa163af1d817dbc292f02d6b0 WatchSource:0}: Error finding container fbbcdee2e21e0e3f7b435ac73e05acf3b47170faa163af1d817dbc292f02d6b0: Status 404 returned error can't find the container with id fbbcdee2e21e0e3f7b435ac73e05acf3b47170faa163af1d817dbc292f02d6b0
Jul 28 19:51:54.298232 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.298203    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"]
Jul 28 19:51:54.301607 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:51:54.301564    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f8eab8_a6ae_42e6_ad08_5b50b3a31e32.slice/crio-79b35c504ecd5d687e80e11980b3a3c48734293b5e38a42f86fd6e927c67039d WatchSource:0}: Error finding container 79b35c504ecd5d687e80e11980b3a3c48734293b5e38a42f86fd6e927c67039d: Status 404 returned error can't find the container with id 79b35c504ecd5d687e80e11980b3a3c48734293b5e38a42f86fd6e927c67039d
Jul 28 19:51:54.413779 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.413731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq" event={"ID":"fd61d2be-22b2-4a75-a5e2-97c2725d7750","Type":"ContainerStarted","Data":"fbbcdee2e21e0e3f7b435ac73e05acf3b47170faa163af1d817dbc292f02d6b0"}
Jul 28 19:51:54.415009 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.414980    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2sht7" event={"ID":"615eb736-5a59-470f-81cd-f1182ebe0dec","Type":"ContainerStarted","Data":"a6631e258c63e4aa677f503dd9066f39dfce2b11af9415426342a8cece90c704"}
Jul 28 19:51:54.416324 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:54.416300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f" event={"ID":"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32","Type":"ContainerStarted","Data":"79b35c504ecd5d687e80e11980b3a3c48734293b5e38a42f86fd6e927c67039d"}
Jul 28 19:51:58.435991 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.435945    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj" event={"ID":"006712fe-6990-4b24-b581-30925a333721","Type":"ContainerStarted","Data":"565bb0948346378c6cb489be03f54bc40755d874ee184b2a996d9b7a8f5cbb48"}
Jul 28 19:51:58.437890 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.437800    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq" event={"ID":"fd61d2be-22b2-4a75-a5e2-97c2725d7750","Type":"ContainerStarted","Data":"bf419bfe20f2ec1c36be5c75dd795c1ddfb4f3a245792f67229e67d2eb359526"}
Jul 28 19:51:58.437890 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.437864    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:51:58.439559 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.439531    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2sht7" event={"ID":"615eb736-5a59-470f-81cd-f1182ebe0dec","Type":"ContainerStarted","Data":"36a2a1dcacd0929a6b33eac3d74630714543b2d270afad956af55642b7eb5712"}
Jul 28 19:51:58.439699 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.439620    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:51:58.451494 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.451335    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj" podStartSLOduration=1.848952813 podStartE2EDuration="6.451316176s" totalImagesPullingTime="4.602363363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:51:58.451258885 +0000 UTC m=+309.820396003" watchObservedRunningTime="2026-07-28 19:51:58.451316176 +0000 UTC m=+309.820453287"
Jul 28 19:51:58.467688 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.467630    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2sht7" podStartSLOduration=2.850735056 podStartE2EDuration="6.467613396s" totalImagesPullingTime="3.61687834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:51:58.466382632 +0000 UTC m=+309.835519743" watchObservedRunningTime="2026-07-28 19:51:58.467613396 +0000 UTC m=+309.836750510"
Jul 28 19:51:58.485317 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.485256    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq" podStartSLOduration=2.167131494 podStartE2EDuration="5.485232225s" totalImagesPullingTime="3.318100731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:51:58.484507475 +0000 UTC m=+309.853644582" watchObservedRunningTime="2026-07-28 19:51:58.485232225 +0000 UTC m=+309.854369336"
Jul 28 19:51:58.789004 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.788969    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:51:58.789101 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:58.789040    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:51:59.445998 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:59.445960    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f" event={"ID":"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32","Type":"ContainerStarted","Data":"48d73a4e44df771f107bc72a373f76d21ddf7cfe452814cd86656ac113296e33"}
Jul 28 19:51:59.468790 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:51:59.468741    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f" podStartSLOduration=1.984388364 podStartE2EDuration="6.468723754s" totalImagesPullingTime="4.48433539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:51:59.467664025 +0000 UTC m=+310.836801136" watchObservedRunningTime="2026-07-28 19:51:59.468723754 +0000 UTC m=+310.837860858"
Jul 28 19:52:00.185548 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.185506    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"]
Jul 28 19:52:00.190838 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.190813    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.195618 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.195591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wx2bh\""
Jul 28 19:52:00.206588 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.206556    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"]
Jul 28 19:52:00.282788 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.282753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.282788 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.282791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wthbj\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-kube-api-access-wthbj\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.283066 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.282824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.283066 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.282861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.283066 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.282899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5b20a1-8409-4b65-95f0-6af178792aa3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.283066 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.282919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.283066 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.282981    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.283066 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.283028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.283318 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.283081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.288025 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.287997    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"]
Jul 28 19:52:00.295295 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.295267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.303890 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.303863    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"]
Jul 28 19:52:00.384562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.384562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.384562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wthbj\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-kube-api-access-wthbj\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5b20a1-8409-4b65-95f0-6af178792aa3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.384873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.385320    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385875 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.385773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.385956 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.385931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.386020 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.385969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.388525 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.386473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5b20a1-8409-4b65-95f0-6af178792aa3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.388525 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.388114    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.388954 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.388903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.396080 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.396022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.397113 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.397077    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wthbj\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-kube-api-access-wthbj\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.451092 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.450993    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:52:00.452926 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.452904    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:52:00.486343 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.486497 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.486497 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.486497 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486424    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.486497 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.486497 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmb8c\" (UniqueName: \"kubernetes.io/projected/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-kube-api-access-rmb8c\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.486689 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.486689 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.486689 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.486625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.501923 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.501890    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:00.588369 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.587784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588369 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.587857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588369 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmb8c\" (UniqueName: \"kubernetes.io/projected/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-kube-api-access-rmb8c\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.588787 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.589406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.588987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.589406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.589089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.589562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.589544    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.591017 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.590987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.591730 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.591682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.597399 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.597338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.599584 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.599555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmb8c\" (UniqueName: \"kubernetes.io/projected/6eb3cd9d-f725-4eb0-9850-f78357fd41fe-kube-api-access-rmb8c\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f\" (UID: \"6eb3cd9d-f725-4eb0-9850-f78357fd41fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.607832 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.607727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:00.664218 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.664134    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"]
Jul 28 19:52:00.668019 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:52:00.667979    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5b20a1_8409_4b65_95f0_6af178792aa3.slice/crio-3b51383630f4dddbf4a8ba44b9838bfe932b0d58b96d22d4067544a35376792c WatchSource:0}: Error finding container 3b51383630f4dddbf4a8ba44b9838bfe932b0d58b96d22d4067544a35376792c: Status 404 returned error can't find the container with id 3b51383630f4dddbf4a8ba44b9838bfe932b0d58b96d22d4067544a35376792c
Jul 28 19:52:00.755790 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:00.755753    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"]
Jul 28 19:52:00.758988 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:52:00.758953    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb3cd9d_f725_4eb0_9850_f78357fd41fe.slice/crio-963fbb98fe616a9dc8bddb7de672f5d4d727b7009a3915059f513cd8a62cf2ec WatchSource:0}: Error finding container 963fbb98fe616a9dc8bddb7de672f5d4d727b7009a3915059f513cd8a62cf2ec: Status 404 returned error can't find the container with id 963fbb98fe616a9dc8bddb7de672f5d4d727b7009a3915059f513cd8a62cf2ec
Jul 28 19:52:01.455640 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:01.455604    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f" event={"ID":"6eb3cd9d-f725-4eb0-9850-f78357fd41fe","Type":"ContainerStarted","Data":"963fbb98fe616a9dc8bddb7de672f5d4d727b7009a3915059f513cd8a62cf2ec"}
Jul 28 19:52:01.456748 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:01.456724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4" event={"ID":"8d5b20a1-8409-4b65-95f0-6af178792aa3","Type":"ContainerStarted","Data":"3b51383630f4dddbf4a8ba44b9838bfe932b0d58b96d22d4067544a35376792c"}
Jul 28 19:52:02.656720 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.656313    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"]
Jul 28 19:52:02.661204 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.661160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:02.664035 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.664010    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 28 19:52:02.664195 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.664010    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-82f86\""
Jul 28 19:52:02.673104 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.672379    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"]
Jul 28 19:52:02.812967 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.812924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d4pk\" (UniqueName: \"kubernetes.io/projected/c2e1397b-4ef8-4abf-a855-d29161e45e0d-kube-api-access-8d4pk\") pod \"kserve-controller-manager-d6f4b65b8-z9fbn\" (UID: \"c2e1397b-4ef8-4abf-a855-d29161e45e0d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:02.813194 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.812993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2e1397b-4ef8-4abf-a855-d29161e45e0d-cert\") pod \"kserve-controller-manager-d6f4b65b8-z9fbn\" (UID: \"c2e1397b-4ef8-4abf-a855-d29161e45e0d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:02.913875 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.913780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d4pk\" (UniqueName: \"kubernetes.io/projected/c2e1397b-4ef8-4abf-a855-d29161e45e0d-kube-api-access-8d4pk\") pod \"kserve-controller-manager-d6f4b65b8-z9fbn\" (UID: \"c2e1397b-4ef8-4abf-a855-d29161e45e0d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:02.913875 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.913850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2e1397b-4ef8-4abf-a855-d29161e45e0d-cert\") pod \"kserve-controller-manager-d6f4b65b8-z9fbn\" (UID: \"c2e1397b-4ef8-4abf-a855-d29161e45e0d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:02.914094 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:52:02.914015    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 28 19:52:02.914094 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:52:02.914093    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e1397b-4ef8-4abf-a855-d29161e45e0d-cert podName:c2e1397b-4ef8-4abf-a855-d29161e45e0d nodeName:}" failed. No retries permitted until 2026-07-28 19:52:03.414068585 +0000 UTC m=+314.783205674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c2e1397b-4ef8-4abf-a855-d29161e45e0d-cert") pod "kserve-controller-manager-d6f4b65b8-z9fbn" (UID: "c2e1397b-4ef8-4abf-a855-d29161e45e0d") : secret "kserve-webhook-server-cert" not found
Jul 28 19:52:02.940147 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:02.940074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d4pk\" (UniqueName: \"kubernetes.io/projected/c2e1397b-4ef8-4abf-a855-d29161e45e0d-kube-api-access-8d4pk\") pod \"kserve-controller-manager-d6f4b65b8-z9fbn\" (UID: \"c2e1397b-4ef8-4abf-a855-d29161e45e0d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:03.417980 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:03.417943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2e1397b-4ef8-4abf-a855-d29161e45e0d-cert\") pod \"kserve-controller-manager-d6f4b65b8-z9fbn\" (UID: \"c2e1397b-4ef8-4abf-a855-d29161e45e0d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:03.424216 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:03.424158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2e1397b-4ef8-4abf-a855-d29161e45e0d-cert\") pod \"kserve-controller-manager-d6f4b65b8-z9fbn\" (UID: \"c2e1397b-4ef8-4abf-a855-d29161e45e0d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:03.578284 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:03.578241    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:04.130835 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.130790    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:52:04.131188 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.130931    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:52:04.131188 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.130971    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:52:04.136394 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.136348    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:52:04.136511 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.136439    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:52:04.136511 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.136484    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:52:04.196261 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.196221    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"]
Jul 28 19:52:04.199347 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:52:04.199308    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e1397b_4ef8_4abf_a855_d29161e45e0d.slice/crio-5fdbf4eef5716845a0d9ee783d2ab2210659e069e2b8a151c6e4af8895f13ed1 WatchSource:0}: Error finding container 5fdbf4eef5716845a0d9ee783d2ab2210659e069e2b8a151c6e4af8895f13ed1: Status 404 returned error can't find the container with id 5fdbf4eef5716845a0d9ee783d2ab2210659e069e2b8a151c6e4af8895f13ed1
Jul 28 19:52:04.474520 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.474421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4" event={"ID":"8d5b20a1-8409-4b65-95f0-6af178792aa3","Type":"ContainerStarted","Data":"57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef"}
Jul 28 19:52:04.476072 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.476036    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f" event={"ID":"6eb3cd9d-f725-4eb0-9850-f78357fd41fe","Type":"ContainerStarted","Data":"b510642927b736d1dcd9a13a9c2af2519bc2221e81825829359daf3ed967cf31"}
Jul 28 19:52:04.477281 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.477250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn" event={"ID":"c2e1397b-4ef8-4abf-a855-d29161e45e0d","Type":"ContainerStarted","Data":"5fdbf4eef5716845a0d9ee783d2ab2210659e069e2b8a151c6e4af8895f13ed1"}
Jul 28 19:52:04.500056 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.500002    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4" podStartSLOduration=1.034737309 podStartE2EDuration="4.499987012s" totalImagesPullingTime="3.465249703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:52:04.499039053 +0000 UTC m=+315.868176201" watchObservedRunningTime="2026-07-28 19:52:04.499987012 +0000 UTC m=+315.869124121"
Jul 28 19:52:04.501948 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.501928    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:04.518121 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.518057    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f" podStartSLOduration=1.1488169799999999 podStartE2EDuration="4.518034028s" totalImagesPullingTime="3.369217048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:52:04.516883498 +0000 UTC m=+315.886020646" watchObservedRunningTime="2026-07-28 19:52:04.518034028 +0000 UTC m=+315.887171139"
Jul 28 19:52:04.608543 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:04.608505    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:05.332765 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.332724    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"]
Jul 28 19:52:05.333158 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.332925    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f" podUID="28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" containerName="discovery" containerID="cri-o://48d73a4e44df771f107bc72a373f76d21ddf7cfe452814cd86656ac113296e33" gracePeriod=30
Jul 28 19:52:05.486600 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.486554    2575 generic.go:356] "Generic (PLEG): container finished" podID="28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" containerID="48d73a4e44df771f107bc72a373f76d21ddf7cfe452814cd86656ac113296e33" exitCode=0
Jul 28 19:52:05.486786 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.486627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f" event={"ID":"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32","Type":"ContainerDied","Data":"48d73a4e44df771f107bc72a373f76d21ddf7cfe452814cd86656ac113296e33"}
Jul 28 19:52:05.504154 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.504017    2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body=
Jul 28 19:52:05.504154 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.504089    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4" podUID="8d5b20a1-8409-4b65-95f0-6af178792aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused"
Jul 28 19:52:05.594934 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.594865    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:52:05.614072 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.614022    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:05.637654 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.637302    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-token\") pod \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") "
Jul 28 19:52:05.637654 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.637346    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-ca-configmap\") pod \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") "
Jul 28 19:52:05.637654 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.637423    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4hb9\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-kube-api-access-h4hb9\") pod \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") "
Jul 28 19:52:05.637654 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.637455    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-dns-cert\") pod \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") "
Jul 28 19:52:05.638032 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.637836    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" (UID: "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:52:05.638032 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.637892    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-kubeconfig\") pod \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") "
Jul 28 19:52:05.638032 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.637932    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-cacerts\") pod \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") "
Jul 28 19:52:05.638032 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.637974    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-local-certs\") pod \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\" (UID: \"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32\") "
Jul 28 19:52:05.638285 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.638265    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-ca-configmap\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:05.642641 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.642599    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" (UID: "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:52:05.642800 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.642744    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-cacerts" (OuterVolumeSpecName: "cacerts") pod "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" (UID: "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:52:05.644715 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.644668    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-local-certs" (OuterVolumeSpecName: "local-certs") pod "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" (UID: "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:52:05.646115 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.646076    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-token" (OuterVolumeSpecName: "istio-token") pod "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" (UID: "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:52:05.660517 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.660366    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-kube-api-access-h4hb9" (OuterVolumeSpecName: "kube-api-access-h4hb9") pod "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" (UID: "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32"). InnerVolumeSpecName "kube-api-access-h4hb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:52:05.660517 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.660486    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" (UID: "28f8eab8-a6ae-42e6-ad08-5b50b3a31e32"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:52:05.739056 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.739022    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-csr-dns-cert\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:05.739056 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.739058    2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-kubeconfig\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:05.739288 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.739074    2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-cacerts\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:05.739288 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.739095    2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-local-certs\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:05.739288 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.739107    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-istio-token\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:05.739288 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:05.739120    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4hb9\" (UniqueName: \"kubernetes.io/projected/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32-kube-api-access-h4hb9\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:06.493403 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.493360    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f" event={"ID":"28f8eab8-a6ae-42e6-ad08-5b50b3a31e32","Type":"ContainerDied","Data":"79b35c504ecd5d687e80e11980b3a3c48734293b5e38a42f86fd6e927c67039d"}
Jul 28 19:52:06.493403 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.493386    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"
Jul 28 19:52:06.493946 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.493434    2575 scope.go:117] "RemoveContainer" containerID="48d73a4e44df771f107bc72a373f76d21ddf7cfe452814cd86656ac113296e33"
Jul 28 19:52:06.493946 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.493671    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:06.495077 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.495061    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f"
Jul 28 19:52:06.502489 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.502455    2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused" start-of-body=
Jul 28 19:52:06.502648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.502515    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4" podUID="8d5b20a1-8409-4b65-95f0-6af178792aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.21:15021/healthz/ready\": dial tcp 10.133.0.21:15021: connect: connection refused"
Jul 28 19:52:06.532470 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.532439    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"]
Jul 28 19:52:06.538958 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.538874    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f"]
Jul 28 19:52:06.547277 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:06.547235    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"]
Jul 28 19:52:07.257621 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:07.257576    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" path="/var/lib/kubelet/pods/28f8eab8-a6ae-42e6-ad08-5b50b3a31e32/volumes"
Jul 28 19:52:07.499562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:07.499513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn" event={"ID":"c2e1397b-4ef8-4abf-a855-d29161e45e0d","Type":"ContainerStarted","Data":"3824fb524129715464236130d3982bf5aa83a3fcef23ea4d40b7df23271f6828"}
Jul 28 19:52:07.500152 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:07.499572    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4" podUID="8d5b20a1-8409-4b65-95f0-6af178792aa3" containerName="istio-proxy" containerID="cri-o://57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef" gracePeriod=30
Jul 28 19:52:07.567781 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:07.567647    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn" podStartSLOduration=3.024757699 podStartE2EDuration="5.56763179s" totalImagesPullingTime="2.542874091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:52:07.566808646 +0000 UTC m=+318.935945756" watchObservedRunningTime="2026-07-28 19:52:07.56763179 +0000 UTC m=+318.936768919"
Jul 28 19:52:08.503466 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:08.503437    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:09.448591 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:09.448559    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2sht7"
Jul 28 19:52:09.450396 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:09.450379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qp2jq"
Jul 28 19:52:12.746040 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.746013    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:12.802233 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802134    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-envoy\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.802233 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802205    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-token\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.802457 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802246    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wthbj\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-kube-api-access-wthbj\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.802457 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802303    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-socket\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.802457 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802339    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5b20a1-8409-4b65-95f0-6af178792aa3-istiod-ca-cert\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.802621 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802588    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:52:12.802717 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:52:12.802775 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802726    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d5b20a1-8409-4b65-95f0-6af178792aa3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:52:12.802775 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802748    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-certs\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.802875 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802829    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-data\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.802875 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802862    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-credential-socket\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.803131 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.802888    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-podinfo\") pod \"8d5b20a1-8409-4b65-95f0-6af178792aa3\" (UID: \"8d5b20a1-8409-4b65-95f0-6af178792aa3\") "
Jul 28 19:52:12.803513 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.803253    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:52:12.803641 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.803620    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:52:12.803701 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.803678    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d5b20a1-8409-4b65-95f0-6af178792aa3-istiod-ca-cert\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:12.803757 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.803699    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-certs\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:12.803757 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.803714    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-data\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:12.803757 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.803727    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-workload-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:12.804757 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.804732    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-kube-api-access-wthbj" (OuterVolumeSpecName: "kube-api-access-wthbj") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "kube-api-access-wthbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:52:12.804854 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.804747    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:52:12.805142 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.805123    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:52:12.805522 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.805497    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d5b20a1-8409-4b65-95f0-6af178792aa3" (UID: "8d5b20a1-8409-4b65-95f0-6af178792aa3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 19:52:12.904913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.904872    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-token\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:12.904913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.904909    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wthbj\" (UniqueName: \"kubernetes.io/projected/8d5b20a1-8409-4b65-95f0-6af178792aa3-kube-api-access-wthbj\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:12.904913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.904920    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-credential-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:12.905149 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.904929    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-podinfo\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:12.905149 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:12.904938    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d5b20a1-8409-4b65-95f0-6af178792aa3-istio-envoy\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:13.527085 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.526982    2575 generic.go:356] "Generic (PLEG): container finished" podID="8d5b20a1-8409-4b65-95f0-6af178792aa3" containerID="57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef" exitCode=0
Jul 28 19:52:13.527085 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.527032    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"
Jul 28 19:52:13.527085 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.527051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4" event={"ID":"8d5b20a1-8409-4b65-95f0-6af178792aa3","Type":"ContainerDied","Data":"57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef"}
Jul 28 19:52:13.527364 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.527106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4" event={"ID":"8d5b20a1-8409-4b65-95f0-6af178792aa3","Type":"ContainerDied","Data":"3b51383630f4dddbf4a8ba44b9838bfe932b0d58b96d22d4067544a35376792c"}
Jul 28 19:52:13.527364 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.527137    2575 scope.go:117] "RemoveContainer" containerID="57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef"
Jul 28 19:52:13.535991 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.535971    2575 scope.go:117] "RemoveContainer" containerID="57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef"
Jul 28 19:52:13.536320 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:52:13.536296    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef\": container with ID starting with 57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef not found: ID does not exist" containerID="57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef"
Jul 28 19:52:13.536425 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.536328    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef"} err="failed to get container status \"57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef\": rpc error: code = NotFound desc = could not find container \"57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef\": container with ID starting with 57e66858326fb0d4572094c8a24e836d616479559b8b90c7a74ec4a1b433bdef not found: ID does not exist"
Jul 28 19:52:13.548513 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.548480    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"]
Jul 28 19:52:13.552462 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:13.552431    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4"]
Jul 28 19:52:15.257777 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:15.257743    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d5b20a1-8409-4b65-95f0-6af178792aa3" path="/var/lib/kubelet/pods/8d5b20a1-8409-4b65-95f0-6af178792aa3/volumes"
Jul 28 19:52:39.514718 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:39.514683    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z9fbn"
Jul 28 19:52:53.705908 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.705871    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4kp99"]
Jul 28 19:52:53.706328 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.706186    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" containerName="discovery"
Jul 28 19:52:53.706328 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.706198    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" containerName="discovery"
Jul 28 19:52:53.706328 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.706210    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5b20a1-8409-4b65-95f0-6af178792aa3" containerName="istio-proxy"
Jul 28 19:52:53.706328 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.706215    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5b20a1-8409-4b65-95f0-6af178792aa3" containerName="istio-proxy"
Jul 28 19:52:53.706328 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.706261    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d5b20a1-8409-4b65-95f0-6af178792aa3" containerName="istio-proxy"
Jul 28 19:52:53.706328 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.706269    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="28f8eab8-a6ae-42e6-ad08-5b50b3a31e32" containerName="discovery"
Jul 28 19:52:53.709661 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.709642    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4kp99"
Jul 28 19:52:53.714051 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.714023    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-446lt\""
Jul 28 19:52:53.714855 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.714824    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 19:52:53.715213 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.715190    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 19:52:53.725319 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.725285    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4kp99"]
Jul 28 19:52:53.850957 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.850914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcggb\" (UniqueName: \"kubernetes.io/projected/af8f5d74-e481-4d60-b5ae-818d139ff0f1-kube-api-access-kcggb\") pod \"kuadrant-operator-catalog-4kp99\" (UID: \"af8f5d74-e481-4d60-b5ae-818d139ff0f1\") " pod="kuadrant-system/kuadrant-operator-catalog-4kp99"
Jul 28 19:52:53.951446 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.951404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcggb\" (UniqueName: \"kubernetes.io/projected/af8f5d74-e481-4d60-b5ae-818d139ff0f1-kube-api-access-kcggb\") pod \"kuadrant-operator-catalog-4kp99\" (UID: \"af8f5d74-e481-4d60-b5ae-818d139ff0f1\") " pod="kuadrant-system/kuadrant-operator-catalog-4kp99"
Jul 28 19:52:53.961135 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:53.961060    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcggb\" (UniqueName: \"kubernetes.io/projected/af8f5d74-e481-4d60-b5ae-818d139ff0f1-kube-api-access-kcggb\") pod \"kuadrant-operator-catalog-4kp99\" (UID: \"af8f5d74-e481-4d60-b5ae-818d139ff0f1\") " pod="kuadrant-system/kuadrant-operator-catalog-4kp99"
Jul 28 19:52:54.020026 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.019986    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4kp99"
Jul 28 19:52:54.030039 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.029989    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4kp99"]
Jul 28 19:52:54.170035 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.169999    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4kp99"]
Jul 28 19:52:54.174047 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:52:54.174014    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8f5d74_e481_4d60_b5ae_818d139ff0f1.slice/crio-ffc1a533ca1a88cfcf126da93e3513fcb49fa435a68451a406a5f1d8812fd973 WatchSource:0}: Error finding container ffc1a533ca1a88cfcf126da93e3513fcb49fa435a68451a406a5f1d8812fd973: Status 404 returned error can't find the container with id ffc1a533ca1a88cfcf126da93e3513fcb49fa435a68451a406a5f1d8812fd973
Jul 28 19:52:54.240482 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.240447    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-64cgr"]
Jul 28 19:52:54.243660 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.243641    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:52:54.257654 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.257619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-64cgr"]
Jul 28 19:52:54.354586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.354539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42nj\" (UniqueName: \"kubernetes.io/projected/243dcbc0-5464-42e2-9a12-45d435930862-kube-api-access-r42nj\") pod \"kuadrant-operator-catalog-64cgr\" (UID: \"243dcbc0-5464-42e2-9a12-45d435930862\") " pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:52:54.455466 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.455430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r42nj\" (UniqueName: \"kubernetes.io/projected/243dcbc0-5464-42e2-9a12-45d435930862-kube-api-access-r42nj\") pod \"kuadrant-operator-catalog-64cgr\" (UID: \"243dcbc0-5464-42e2-9a12-45d435930862\") " pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:52:54.466918 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.466893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42nj\" (UniqueName: \"kubernetes.io/projected/243dcbc0-5464-42e2-9a12-45d435930862-kube-api-access-r42nj\") pod \"kuadrant-operator-catalog-64cgr\" (UID: \"243dcbc0-5464-42e2-9a12-45d435930862\") " pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:52:54.553319 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.553213    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:52:54.697311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.697277    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-64cgr"]
Jul 28 19:52:54.698394 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:54.698369    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4kp99" event={"ID":"af8f5d74-e481-4d60-b5ae-818d139ff0f1","Type":"ContainerStarted","Data":"ffc1a533ca1a88cfcf126da93e3513fcb49fa435a68451a406a5f1d8812fd973"}
Jul 28 19:52:54.700281 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:52:54.700259    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243dcbc0_5464_42e2_9a12_45d435930862.slice/crio-6ea337eb0494d155be75f2e95598909bd5c3d776053a4f18d6918e1c8685039a WatchSource:0}: Error finding container 6ea337eb0494d155be75f2e95598909bd5c3d776053a4f18d6918e1c8685039a: Status 404 returned error can't find the container with id 6ea337eb0494d155be75f2e95598909bd5c3d776053a4f18d6918e1c8685039a
Jul 28 19:52:55.705932 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:55.705889    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-64cgr" event={"ID":"243dcbc0-5464-42e2-9a12-45d435930862","Type":"ContainerStarted","Data":"6ea337eb0494d155be75f2e95598909bd5c3d776053a4f18d6918e1c8685039a"}
Jul 28 19:52:56.711662 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:56.711552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4kp99" event={"ID":"af8f5d74-e481-4d60-b5ae-818d139ff0f1","Type":"ContainerStarted","Data":"35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108"}
Jul 28 19:52:56.711662 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:56.711605    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4kp99" podUID="af8f5d74-e481-4d60-b5ae-818d139ff0f1" containerName="registry-server" containerID="cri-o://35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108" gracePeriod=2
Jul 28 19:52:56.713364 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:56.713339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-64cgr" event={"ID":"243dcbc0-5464-42e2-9a12-45d435930862","Type":"ContainerStarted","Data":"d57e3f17cdd7fbae94c827b7fd23c99c5a25abefbfd3ac798b1cb7eec0e62f39"}
Jul 28 19:52:56.731148 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:56.731104    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4kp99" podStartSLOduration=1.669683586 podStartE2EDuration="3.731087386s" totalImagesPullingTime="2.0614038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:52:56.730316886 +0000 UTC m=+368.099453996" watchObservedRunningTime="2026-07-28 19:52:56.731087386 +0000 UTC m=+368.100224517"
Jul 28 19:52:56.748603 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:56.748557    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-64cgr" podStartSLOduration=1.180147204 podStartE2EDuration="2.748541738s" totalImagesPullingTime="1.568394534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:52:56.747322654 +0000 UTC m=+368.116459765" watchObservedRunningTime="2026-07-28 19:52:56.748541738 +0000 UTC m=+368.117678868"
Jul 28 19:52:56.965286 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:56.965222    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4kp99"
Jul 28 19:52:57.078188 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.078123    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcggb\" (UniqueName: \"kubernetes.io/projected/af8f5d74-e481-4d60-b5ae-818d139ff0f1-kube-api-access-kcggb\") pod \"af8f5d74-e481-4d60-b5ae-818d139ff0f1\" (UID: \"af8f5d74-e481-4d60-b5ae-818d139ff0f1\") "
Jul 28 19:52:57.080514 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.080485    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af8f5d74-e481-4d60-b5ae-818d139ff0f1-kube-api-access-kcggb" (OuterVolumeSpecName: "kube-api-access-kcggb") pod "af8f5d74-e481-4d60-b5ae-818d139ff0f1" (UID: "af8f5d74-e481-4d60-b5ae-818d139ff0f1"). InnerVolumeSpecName "kube-api-access-kcggb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:52:57.179258 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.179217    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcggb\" (UniqueName: \"kubernetes.io/projected/af8f5d74-e481-4d60-b5ae-818d139ff0f1-kube-api-access-kcggb\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:52:57.719556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.719466    2575 generic.go:356] "Generic (PLEG): container finished" podID="af8f5d74-e481-4d60-b5ae-818d139ff0f1" containerID="35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108" exitCode=0
Jul 28 19:52:57.719556 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.719512    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4kp99"
Jul 28 19:52:57.720016 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.719551    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4kp99" event={"ID":"af8f5d74-e481-4d60-b5ae-818d139ff0f1","Type":"ContainerDied","Data":"35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108"}
Jul 28 19:52:57.720016 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.719599    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4kp99" event={"ID":"af8f5d74-e481-4d60-b5ae-818d139ff0f1","Type":"ContainerDied","Data":"ffc1a533ca1a88cfcf126da93e3513fcb49fa435a68451a406a5f1d8812fd973"}
Jul 28 19:52:57.720016 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.719626    2575 scope.go:117] "RemoveContainer" containerID="35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108"
Jul 28 19:52:57.728809 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.728787    2575 scope.go:117] "RemoveContainer" containerID="35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108"
Jul 28 19:52:57.729116 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:52:57.729098    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108\": container with ID starting with 35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108 not found: ID does not exist" containerID="35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108"
Jul 28 19:52:57.729159 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.729127    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108"} err="failed to get container status \"35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108\": rpc error: code = NotFound desc = could not find container \"35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108\": container with ID starting with 35e008e3a522c5d2580383e40d21025f2ce8bbff0b9822cfeb932fb2c24e5108 not found: ID does not exist"
Jul 28 19:52:57.736460 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.736428    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4kp99"]
Jul 28 19:52:57.743849 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:57.743819    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4kp99"]
Jul 28 19:52:59.258774 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:52:59.258739    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af8f5d74-e481-4d60-b5ae-818d139ff0f1" path="/var/lib/kubelet/pods/af8f5d74-e481-4d60-b5ae-818d139ff0f1/volumes"
Jul 28 19:53:04.553408 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:04.553380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:53:04.553906 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:04.553477    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:53:04.575362 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:04.575335    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:53:04.771300 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:04.771267    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-64cgr"
Jul 28 19:53:27.890396 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.890363    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"]
Jul 28 19:53:27.890939 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.890665    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8f5d74-e481-4d60-b5ae-818d139ff0f1" containerName="registry-server"
Jul 28 19:53:27.890939 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.890676    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8f5d74-e481-4d60-b5ae-818d139ff0f1" containerName="registry-server"
Jul 28 19:53:27.890939 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.890751    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="af8f5d74-e481-4d60-b5ae-818d139ff0f1" containerName="registry-server"
Jul 28 19:53:27.894753 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.894730    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:27.897495 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.897470    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nnmnz\""
Jul 28 19:53:27.909963 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.909932    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"]
Jul 28 19:53:27.924583 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.924549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5ktm\" (UniqueName: \"kubernetes.io/projected/a7af8a0c-9acc-431a-935a-e52dd1477efc-kube-api-access-j5ktm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" (UID: \"a7af8a0c-9acc-431a-935a-e52dd1477efc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:27.924751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:27.924589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7af8a0c-9acc-431a-935a-e52dd1477efc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" (UID: \"a7af8a0c-9acc-431a-935a-e52dd1477efc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:28.025861 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:28.025824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5ktm\" (UniqueName: \"kubernetes.io/projected/a7af8a0c-9acc-431a-935a-e52dd1477efc-kube-api-access-j5ktm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" (UID: \"a7af8a0c-9acc-431a-935a-e52dd1477efc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:28.025861 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:28.025865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7af8a0c-9acc-431a-935a-e52dd1477efc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" (UID: \"a7af8a0c-9acc-431a-935a-e52dd1477efc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:28.026298 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:28.026282    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7af8a0c-9acc-431a-935a-e52dd1477efc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" (UID: \"a7af8a0c-9acc-431a-935a-e52dd1477efc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:28.045473 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:28.045436    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5ktm\" (UniqueName: \"kubernetes.io/projected/a7af8a0c-9acc-431a-935a-e52dd1477efc-kube-api-access-j5ktm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" (UID: \"a7af8a0c-9acc-431a-935a-e52dd1477efc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:28.205374 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:28.205276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:28.344492 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:28.344457    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"]
Jul 28 19:53:28.348634 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:53:28.348605    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7af8a0c_9acc_431a_935a_e52dd1477efc.slice/crio-6260e200d0fcd540bb6e79da3c75490d7d1f9b359106a2570328e33fad4bd841 WatchSource:0}: Error finding container 6260e200d0fcd540bb6e79da3c75490d7d1f9b359106a2570328e33fad4bd841: Status 404 returned error can't find the container with id 6260e200d0fcd540bb6e79da3c75490d7d1f9b359106a2570328e33fad4bd841
Jul 28 19:53:28.852450 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:28.852416    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s" event={"ID":"a7af8a0c-9acc-431a-935a-e52dd1477efc","Type":"ContainerStarted","Data":"6260e200d0fcd540bb6e79da3c75490d7d1f9b359106a2570328e33fad4bd841"}
Jul 28 19:53:29.961312 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:29.961277    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"]
Jul 28 19:53:29.963670 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:29.963642    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"
Jul 28 19:53:29.966099 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:29.966076    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sdrgt\""
Jul 28 19:53:29.966356 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:29.966341    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 19:53:29.974835 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:29.974806    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"]
Jul 28 19:53:30.043235 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:30.043202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzfbt\" (UniqueName: \"kubernetes.io/projected/4f32d061-699f-4036-9239-9afc9f5ee387-kube-api-access-kzfbt\") pod \"dns-operator-controller-manager-864dd78c4c-b5cwj\" (UID: \"4f32d061-699f-4036-9239-9afc9f5ee387\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"
Jul 28 19:53:30.144262 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:30.144227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzfbt\" (UniqueName: \"kubernetes.io/projected/4f32d061-699f-4036-9239-9afc9f5ee387-kube-api-access-kzfbt\") pod \"dns-operator-controller-manager-864dd78c4c-b5cwj\" (UID: \"4f32d061-699f-4036-9239-9afc9f5ee387\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"
Jul 28 19:53:30.158828 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:30.158803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzfbt\" (UniqueName: \"kubernetes.io/projected/4f32d061-699f-4036-9239-9afc9f5ee387-kube-api-access-kzfbt\") pod \"dns-operator-controller-manager-864dd78c4c-b5cwj\" (UID: \"4f32d061-699f-4036-9239-9afc9f5ee387\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"
Jul 28 19:53:30.276740 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:30.276698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"
Jul 28 19:53:30.421562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:30.421539    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"]
Jul 28 19:53:30.424509 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:53:30.424463    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f32d061_699f_4036_9239_9afc9f5ee387.slice/crio-c20ac9307399ccb95546c9e5862e011fb94e7c020d5a4f68d41baf31ca26c021 WatchSource:0}: Error finding container c20ac9307399ccb95546c9e5862e011fb94e7c020d5a4f68d41baf31ca26c021: Status 404 returned error can't find the container with id c20ac9307399ccb95546c9e5862e011fb94e7c020d5a4f68d41baf31ca26c021
Jul 28 19:53:30.863508 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:30.863475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj" event={"ID":"4f32d061-699f-4036-9239-9afc9f5ee387","Type":"ContainerStarted","Data":"c20ac9307399ccb95546c9e5862e011fb94e7c020d5a4f68d41baf31ca26c021"}
Jul 28 19:53:33.135944 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.135909    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"]
Jul 28 19:53:33.139589 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.139562    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"
Jul 28 19:53:33.142250 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.142215    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-f9sk4\""
Jul 28 19:53:33.148894 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.148863    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"]
Jul 28 19:53:33.276658 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.276616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chdmq\" (UniqueName: \"kubernetes.io/projected/dc1e8dce-2971-4f46-91ec-83751edb1c08-kube-api-access-chdmq\") pod \"authorino-operator-75cc8d5cb7-s7zpl\" (UID: \"dc1e8dce-2971-4f46-91ec-83751edb1c08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"
Jul 28 19:53:33.378254 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.378203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chdmq\" (UniqueName: \"kubernetes.io/projected/dc1e8dce-2971-4f46-91ec-83751edb1c08-kube-api-access-chdmq\") pod \"authorino-operator-75cc8d5cb7-s7zpl\" (UID: \"dc1e8dce-2971-4f46-91ec-83751edb1c08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"
Jul 28 19:53:33.388528 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.388437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chdmq\" (UniqueName: \"kubernetes.io/projected/dc1e8dce-2971-4f46-91ec-83751edb1c08-kube-api-access-chdmq\") pod \"authorino-operator-75cc8d5cb7-s7zpl\" (UID: \"dc1e8dce-2971-4f46-91ec-83751edb1c08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"
Jul 28 19:53:33.453835 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.453791    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"
Jul 28 19:53:33.647672 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.647646    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"]
Jul 28 19:53:33.649978 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:53:33.649954    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1e8dce_2971_4f46_91ec_83751edb1c08.slice/crio-eb819babd67490144975eb06224c333188c44891c8a65edbe2b4329779d179fe WatchSource:0}: Error finding container eb819babd67490144975eb06224c333188c44891c8a65edbe2b4329779d179fe: Status 404 returned error can't find the container with id eb819babd67490144975eb06224c333188c44891c8a65edbe2b4329779d179fe
Jul 28 19:53:33.879214 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.879148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl" event={"ID":"dc1e8dce-2971-4f46-91ec-83751edb1c08","Type":"ContainerStarted","Data":"eb819babd67490144975eb06224c333188c44891c8a65edbe2b4329779d179fe"}
Jul 28 19:53:33.880808 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.880779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s" event={"ID":"a7af8a0c-9acc-431a-935a-e52dd1477efc","Type":"ContainerStarted","Data":"71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f"}
Jul 28 19:53:33.880966 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.880865    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:33.882760 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.882724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj" event={"ID":"4f32d061-699f-4036-9239-9afc9f5ee387","Type":"ContainerStarted","Data":"823b078cbc2fb355e92564fecd4a9a656b567a676b0cbec8a003315b3f6cb786"}
Jul 28 19:53:33.882917 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.882873    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"
Jul 28 19:53:33.906119 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.906019    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s" podStartSLOduration=1.7550129380000001 podStartE2EDuration="6.906001108s" totalImagesPullingTime="5.15098817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:53:33.904889388 +0000 UTC m=+405.274026502" watchObservedRunningTime="2026-07-28 19:53:33.906001108 +0000 UTC m=+405.275138219"
Jul 28 19:53:33.931688 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:33.931627    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj" podStartSLOduration=1.871235538 podStartE2EDuration="4.93161021s" totalImagesPullingTime="3.060374672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:53:33.929843613 +0000 UTC m=+405.298980722" watchObservedRunningTime="2026-07-28 19:53:33.93161021 +0000 UTC m=+405.300747320"
Jul 28 19:53:35.744466 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:35.741157    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"]
Jul 28 19:53:35.746043 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:35.746008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:35.748898 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:35.748872    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wmkws\""
Jul 28 19:53:35.753196 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:35.753149    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"]
Jul 28 19:53:35.801901 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:35.801857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fdg\" (UniqueName: \"kubernetes.io/projected/3d7abed2-6d68-4a02-91cb-ef07392b3b6a-kube-api-access-p9fdg\") pod \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" (UID: \"3d7abed2-6d68-4a02-91cb-ef07392b3b6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:35.902465 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:35.902424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fdg\" (UniqueName: \"kubernetes.io/projected/3d7abed2-6d68-4a02-91cb-ef07392b3b6a-kube-api-access-p9fdg\") pod \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" (UID: \"3d7abed2-6d68-4a02-91cb-ef07392b3b6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:35.913525 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:35.913489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fdg\" (UniqueName: \"kubernetes.io/projected/3d7abed2-6d68-4a02-91cb-ef07392b3b6a-kube-api-access-p9fdg\") pod \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" (UID: \"3d7abed2-6d68-4a02-91cb-ef07392b3b6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:36.059921 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.059897    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:36.230896 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.230853    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"]
Jul 28 19:53:36.233280 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:53:36.233251    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7abed2_6d68_4a02_91cb_ef07392b3b6a.slice/crio-2ef019ebcab3e74eb55700c92910ccc07cf277992f664455d2ad7fd87fbe304d WatchSource:0}: Error finding container 2ef019ebcab3e74eb55700c92910ccc07cf277992f664455d2ad7fd87fbe304d: Status 404 returned error can't find the container with id 2ef019ebcab3e74eb55700c92910ccc07cf277992f664455d2ad7fd87fbe304d
Jul 28 19:53:36.817343 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.817305    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"]
Jul 28 19:53:36.821096 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.821065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:36.823557 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.823520    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 28 19:53:36.823709 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.823609    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mflq8\""
Jul 28 19:53:36.823709 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.823674    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 28 19:53:36.828843 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.828514    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"]
Jul 28 19:53:36.902018 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.901978    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk" event={"ID":"3d7abed2-6d68-4a02-91cb-ef07392b3b6a","Type":"ContainerStarted","Data":"2ef019ebcab3e74eb55700c92910ccc07cf277992f664455d2ad7fd87fbe304d"}
Jul 28 19:53:36.904236 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.904193    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl" event={"ID":"dc1e8dce-2971-4f46-91ec-83751edb1c08","Type":"ContainerStarted","Data":"ce15140940bfdff8e31f942fcf0f8cadea4cf110c7ee27f4330b6ae8e3f23684"}
Jul 28 19:53:36.904394 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.904348    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"
Jul 28 19:53:36.911470 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.911436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2166cd85-e9d5-4d8b-8838-f6de91040918-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:36.911629 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.911545    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2166cd85-e9d5-4d8b-8838-f6de91040918-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:36.911629 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.911609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn7ps\" (UniqueName: \"kubernetes.io/projected/2166cd85-e9d5-4d8b-8838-f6de91040918-kube-api-access-bn7ps\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:36.928978 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:36.928910    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl" podStartSLOduration=1.554772506 podStartE2EDuration="3.928885294s" totalImagesPullingTime="2.374112788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:53:36.926820061 +0000 UTC m=+408.295957173" watchObservedRunningTime="2026-07-28 19:53:36.928885294 +0000 UTC m=+408.298022407"
Jul 28 19:53:37.012550 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.012509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2166cd85-e9d5-4d8b-8838-f6de91040918-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:37.012749 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.012606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn7ps\" (UniqueName: \"kubernetes.io/projected/2166cd85-e9d5-4d8b-8838-f6de91040918-kube-api-access-bn7ps\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:37.012749 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.012644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2166cd85-e9d5-4d8b-8838-f6de91040918-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:37.012867 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:37.012813    2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 28 19:53:37.013120 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:37.012978    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2166cd85-e9d5-4d8b-8838-f6de91040918-plugin-serving-cert podName:2166cd85-e9d5-4d8b-8838-f6de91040918 nodeName:}" failed. No retries permitted until 2026-07-28 19:53:37.512858251 +0000 UTC m=+408.881995341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2166cd85-e9d5-4d8b-8838-f6de91040918-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-qwcvr" (UID: "2166cd85-e9d5-4d8b-8838-f6de91040918") : secret "plugin-serving-cert" not found
Jul 28 19:53:37.013409 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.013382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2166cd85-e9d5-4d8b-8838-f6de91040918-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:37.027400 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.027360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn7ps\" (UniqueName: \"kubernetes.io/projected/2166cd85-e9d5-4d8b-8838-f6de91040918-kube-api-access-bn7ps\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:37.516068 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.516025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2166cd85-e9d5-4d8b-8838-f6de91040918-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:37.519124 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.519085    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2166cd85-e9d5-4d8b-8838-f6de91040918-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qwcvr\" (UID: \"2166cd85-e9d5-4d8b-8838-f6de91040918\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:37.735560 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.735526    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"
Jul 28 19:53:37.892294 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.892258    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr"]
Jul 28 19:53:37.895625 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:53:37.895588    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2166cd85_e9d5_4d8b_8838_f6de91040918.slice/crio-524803cbec069b8177571df10f3f72ae4e774cc9a9d16eb87e64fa0afca9d4a6 WatchSource:0}: Error finding container 524803cbec069b8177571df10f3f72ae4e774cc9a9d16eb87e64fa0afca9d4a6: Status 404 returned error can't find the container with id 524803cbec069b8177571df10f3f72ae4e774cc9a9d16eb87e64fa0afca9d4a6
Jul 28 19:53:37.910493 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.910453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk" event={"ID":"3d7abed2-6d68-4a02-91cb-ef07392b3b6a","Type":"ContainerStarted","Data":"6d51594327496fe37c95d254e61e1d932a45104a9c25d97fe7a282250f5e0d1c"}
Jul 28 19:53:37.910680 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.910596    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:37.911765 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.911740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr" event={"ID":"2166cd85-e9d5-4d8b-8838-f6de91040918","Type":"ContainerStarted","Data":"524803cbec069b8177571df10f3f72ae4e774cc9a9d16eb87e64fa0afca9d4a6"}
Jul 28 19:53:37.927837 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:37.927781    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk" podStartSLOduration=1.3655724089999999 podStartE2EDuration="2.927763493s" totalImagesPullingTime="1.562191084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:53:37.927720294 +0000 UTC m=+409.296857405" watchObservedRunningTime="2026-07-28 19:53:37.927763493 +0000 UTC m=+409.296900580"
Jul 28 19:53:44.890648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:44.890606    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:44.891147 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:44.890797    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b5cwj"
Jul 28 19:53:46.905115 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.905078    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"]
Jul 28 19:53:46.905575 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.905323    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" containerName="manager" containerID="cri-o://71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f" gracePeriod=2
Jul 28 19:53:46.910758 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.910735    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"]
Jul 28 19:53:46.932082 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.932053    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"]
Jul 28 19:53:46.932311 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.932282    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" containerName="manager" containerID="cri-o://6d51594327496fe37c95d254e61e1d932a45104a9c25d97fe7a282250f5e0d1c" gracePeriod=2
Jul 28 19:53:46.934460 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.934434    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:46.936527 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:46.936492    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:46.938782 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:46.938746    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:46.940922 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.940742    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"]
Jul 28 19:53:46.940922 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:46.940903    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:46.942880 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.942854    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"]
Jul 28 19:53:46.943269 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.943248    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" containerName="manager"
Jul 28 19:53:46.943269 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.943269    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" containerName="manager"
Jul 28 19:53:46.943394 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.943281    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" containerName="manager"
Jul 28 19:53:46.943394 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.943287    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" containerName="manager"
Jul 28 19:53:46.943394 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.943388    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" containerName="manager"
Jul 28 19:53:46.943394 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.943396    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" containerName="manager"
Jul 28 19:53:46.944341 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:46.944317    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:46.946524 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.946507    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:53:46.962226 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.962190    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"]
Jul 28 19:53:46.973715 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.973672    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"]
Jul 28 19:53:46.978502 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:46.978476    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"
Jul 28 19:53:47.004752 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.004717    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"]
Jul 28 19:53:47.020388 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:47.016975    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:47.020388 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:47.019410    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:47.023638 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:47.023600    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:53:47.068244 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:53:47.068202    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:53:47.110479 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.110438    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18c461e-7b4e-4c68-bffa-3a01031272e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-82r9g\" (UID: \"e18c461e-7b4e-4c68-bffa-3a01031272e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:53:47.110479 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.110478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cgmd\" (UniqueName: \"kubernetes.io/projected/e18c461e-7b4e-4c68-bffa-3a01031272e8-kube-api-access-4cgmd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-82r9g\" (UID: \"e18c461e-7b4e-4c68-bffa-3a01031272e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:53:47.110735 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.110616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vctd8\" (UniqueName: \"kubernetes.io/projected/61063d9e-396f-4f4d-b2b0-9708c3d5bd01-kube-api-access-vctd8\") pod \"limitador-operator-controller-manager-859d7b78bd-hgpbv\" (UID: \"61063d9e-396f-4f4d-b2b0-9708c3d5bd01\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"
Jul 28 19:53:47.211465 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.211360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vctd8\" (UniqueName: \"kubernetes.io/projected/61063d9e-396f-4f4d-b2b0-9708c3d5bd01-kube-api-access-vctd8\") pod \"limitador-operator-controller-manager-859d7b78bd-hgpbv\" (UID: \"61063d9e-396f-4f4d-b2b0-9708c3d5bd01\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"
Jul 28 19:53:47.211465 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.211464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18c461e-7b4e-4c68-bffa-3a01031272e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-82r9g\" (UID: \"e18c461e-7b4e-4c68-bffa-3a01031272e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:53:47.211673 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.211493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cgmd\" (UniqueName: \"kubernetes.io/projected/e18c461e-7b4e-4c68-bffa-3a01031272e8-kube-api-access-4cgmd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-82r9g\" (UID: \"e18c461e-7b4e-4c68-bffa-3a01031272e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:53:47.211946 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.211923    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18c461e-7b4e-4c68-bffa-3a01031272e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-82r9g\" (UID: \"e18c461e-7b4e-4c68-bffa-3a01031272e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:53:47.224900 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.224864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cgmd\" (UniqueName: \"kubernetes.io/projected/e18c461e-7b4e-4c68-bffa-3a01031272e8-kube-api-access-4cgmd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-82r9g\" (UID: \"e18c461e-7b4e-4c68-bffa-3a01031272e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:53:47.225245 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.225222    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vctd8\" (UniqueName: \"kubernetes.io/projected/61063d9e-396f-4f4d-b2b0-9708c3d5bd01-kube-api-access-vctd8\") pod \"limitador-operator-controller-manager-859d7b78bd-hgpbv\" (UID: \"61063d9e-396f-4f4d-b2b0-9708c3d5bd01\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"
Jul 28 19:53:47.324924 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.324882    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:53:47.333878 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.333842    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"
Jul 28 19:53:47.914950 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:53:47.914923    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s7zpl"
Jul 28 19:54:01.050490 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.050450    2575 generic.go:356] "Generic (PLEG): container finished" podID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" containerID="6d51594327496fe37c95d254e61e1d932a45104a9c25d97fe7a282250f5e0d1c" exitCode=0
Jul 28 19:54:01.249381 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.249315    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"]
Jul 28 19:54:01.252160 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:01.252123    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61063d9e_396f_4f4d_b2b0_9708c3d5bd01.slice/crio-fd5e5c68978c7fe0d04415e9e35a498f3cd38bb88c6f6befca31b10cafed5378 WatchSource:0}: Error finding container fd5e5c68978c7fe0d04415e9e35a498f3cd38bb88c6f6befca31b10cafed5378: Status 404 returned error can't find the container with id fd5e5c68978c7fe0d04415e9e35a498f3cd38bb88c6f6befca31b10cafed5378
Jul 28 19:54:01.260303 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.260278    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:54:01.263654 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:01.263624    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:54:01.273919 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.273894    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"]
Jul 28 19:54:01.276199 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:01.276147    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18c461e_7b4e_4c68_bffa_3a01031272e8.slice/crio-587d57d059a3bdc311eb4e8b585b07cfd8b789c12d11c5d62b8a2dda4aa0d368 WatchSource:0}: Error finding container 587d57d059a3bdc311eb4e8b585b07cfd8b789c12d11c5d62b8a2dda4aa0d368: Status 404 returned error can't find the container with id 587d57d059a3bdc311eb4e8b585b07cfd8b789c12d11c5d62b8a2dda4aa0d368
Jul 28 19:54:01.279683 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.279660    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:54:01.281919 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:01.281888    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:54:01.283941 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:01.283906    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:54:01.334264 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.334237    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5ktm\" (UniqueName: \"kubernetes.io/projected/a7af8a0c-9acc-431a-935a-e52dd1477efc-kube-api-access-j5ktm\") pod \"a7af8a0c-9acc-431a-935a-e52dd1477efc\" (UID: \"a7af8a0c-9acc-431a-935a-e52dd1477efc\") "
Jul 28 19:54:01.334264 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.334275    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7af8a0c-9acc-431a-935a-e52dd1477efc-extensions-socket-volume\") pod \"a7af8a0c-9acc-431a-935a-e52dd1477efc\" (UID: \"a7af8a0c-9acc-431a-935a-e52dd1477efc\") "
Jul 28 19:54:01.334501 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.334334    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9fdg\" (UniqueName: \"kubernetes.io/projected/3d7abed2-6d68-4a02-91cb-ef07392b3b6a-kube-api-access-p9fdg\") pod \"3d7abed2-6d68-4a02-91cb-ef07392b3b6a\" (UID: \"3d7abed2-6d68-4a02-91cb-ef07392b3b6a\") "
Jul 28 19:54:01.335241 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.335207    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7af8a0c-9acc-431a-935a-e52dd1477efc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a7af8a0c-9acc-431a-935a-e52dd1477efc" (UID: "a7af8a0c-9acc-431a-935a-e52dd1477efc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:54:01.336646 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.336613    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7abed2-6d68-4a02-91cb-ef07392b3b6a-kube-api-access-p9fdg" (OuterVolumeSpecName: "kube-api-access-p9fdg") pod "3d7abed2-6d68-4a02-91cb-ef07392b3b6a" (UID: "3d7abed2-6d68-4a02-91cb-ef07392b3b6a"). InnerVolumeSpecName "kube-api-access-p9fdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:54:01.336797 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.336657    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7af8a0c-9acc-431a-935a-e52dd1477efc-kube-api-access-j5ktm" (OuterVolumeSpecName: "kube-api-access-j5ktm") pod "a7af8a0c-9acc-431a-935a-e52dd1477efc" (UID: "a7af8a0c-9acc-431a-935a-e52dd1477efc"). InnerVolumeSpecName "kube-api-access-j5ktm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:54:01.435501 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.435467    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9fdg\" (UniqueName: \"kubernetes.io/projected/3d7abed2-6d68-4a02-91cb-ef07392b3b6a-kube-api-access-p9fdg\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:01.435501 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.435495    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5ktm\" (UniqueName: \"kubernetes.io/projected/a7af8a0c-9acc-431a-935a-e52dd1477efc-kube-api-access-j5ktm\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:01.435501 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:01.435504    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7af8a0c-9acc-431a-935a-e52dd1477efc-extensions-socket-volume\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:02.057143 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.057107    2575 generic.go:356] "Generic (PLEG): container finished" podID="a7af8a0c-9acc-431a-935a-e52dd1477efc" containerID="71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f" exitCode=0
Jul 28 19:54:02.057625 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.057161    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:54:02.057625 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.057221    2575 scope.go:117] "RemoveContainer" containerID="71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f"
Jul 28 19:54:02.059309 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.059282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv" event={"ID":"61063d9e-396f-4f4d-b2b0-9708c3d5bd01","Type":"ContainerStarted","Data":"f88c6472145781c8c9f9d3a7b2c1e667a2d9a553f900e3b32b9b9543b11c8b27"}
Jul 28 19:54:02.059440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.059341    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv" event={"ID":"61063d9e-396f-4f4d-b2b0-9708c3d5bd01","Type":"ContainerStarted","Data":"fd5e5c68978c7fe0d04415e9e35a498f3cd38bb88c6f6befca31b10cafed5378"}
Jul 28 19:54:02.059440 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.059367    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"
Jul 28 19:54:02.060930 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.060907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr" event={"ID":"2166cd85-e9d5-4d8b-8838-f6de91040918","Type":"ContainerStarted","Data":"1a3c05d0b61fa135fc74aec8d01862d7d3b935fae19676019061bbb4260ae747"}
Jul 28 19:54:02.062361 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:02.062328    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:54:02.062946 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.062918    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:54:02.064550 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:02.064521    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:54:02.064907 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.064882    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g" event={"ID":"e18c461e-7b4e-4c68-bffa-3a01031272e8","Type":"ContainerStarted","Data":"1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f"}
Jul 28 19:54:02.064987 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.064939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g" event={"ID":"e18c461e-7b4e-4c68-bffa-3a01031272e8","Type":"ContainerStarted","Data":"587d57d059a3bdc311eb4e8b585b07cfd8b789c12d11c5d62b8a2dda4aa0d368"}
Jul 28 19:54:02.065044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.065022    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:54:02.067642 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.067624    2575 scope.go:117] "RemoveContainer" containerID="71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f"
Jul 28 19:54:02.067895 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:02.067879    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f\": container with ID starting with 71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f not found: ID does not exist" containerID="71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f"
Jul 28 19:54:02.067961 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.067900    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f"} err="failed to get container status \"71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f\": rpc error: code = NotFound desc = could not find container \"71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f\": container with ID starting with 71ea45b230a53f3a09f1584c7a571e58c9ad6644cc9d879295232f55969c101f not found: ID does not exist"
Jul 28 19:54:02.067961 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.067915    2575 scope.go:117] "RemoveContainer" containerID="6d51594327496fe37c95d254e61e1d932a45104a9c25d97fe7a282250f5e0d1c"
Jul 28 19:54:02.084452 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.084392    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv" podStartSLOduration=16.084372007 podStartE2EDuration="16.084372007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:02.083664682 +0000 UTC m=+433.452801829" watchObservedRunningTime="2026-07-28 19:54:02.084372007 +0000 UTC m=+433.453509117"
Jul 28 19:54:02.085845 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:02.085814    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:54:02.109767 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.109705    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qwcvr" podStartSLOduration=2.747946457 podStartE2EDuration="26.109676064s" totalImagesPullingTime="23.361729607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:02.108359778 +0000 UTC m=+433.477496888" watchObservedRunningTime="2026-07-28 19:54:02.109676064 +0000 UTC m=+433.478813174"
Jul 28 19:54:02.110685 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:02.110659    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:54:02.137944 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:02.137883    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g" podStartSLOduration=16.137865558 podStartE2EDuration="16.137865558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:02.137574788 +0000 UTC m=+433.506711898" watchObservedRunningTime="2026-07-28 19:54:02.137865558 +0000 UTC m=+433.507002668"
Jul 28 19:54:02.154742 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:02.154698    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l2j6s\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l2j6s"
Jul 28 19:54:02.157127 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:02.157087    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kmrjk\" is forbidden: User \"system:node:ip-10-0-128-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-236.ec2.internal' and this object" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kmrjk"
Jul 28 19:54:03.259113 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:03.259078    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d7abed2-6d68-4a02-91cb-ef07392b3b6a" path="/var/lib/kubelet/pods/3d7abed2-6d68-4a02-91cb-ef07392b3b6a/volumes"
Jul 28 19:54:03.259524 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:03.259467    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7af8a0c-9acc-431a-935a-e52dd1477efc" path="/var/lib/kubelet/pods/a7af8a0c-9acc-431a-935a-e52dd1477efc/volumes"
Jul 28 19:54:04.301228 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.301190    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"]
Jul 28 19:54:04.301749 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.301376    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g" podUID="e18c461e-7b4e-4c68-bffa-3a01031272e8" containerName="manager" containerID="cri-o://1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f" gracePeriod=10
Jul 28 19:54:04.606241 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.606207    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:54:04.660052 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.660000    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cgmd\" (UniqueName: \"kubernetes.io/projected/e18c461e-7b4e-4c68-bffa-3a01031272e8-kube-api-access-4cgmd\") pod \"e18c461e-7b4e-4c68-bffa-3a01031272e8\" (UID: \"e18c461e-7b4e-4c68-bffa-3a01031272e8\") "
Jul 28 19:54:04.660277 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.660090    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18c461e-7b4e-4c68-bffa-3a01031272e8-extensions-socket-volume\") pod \"e18c461e-7b4e-4c68-bffa-3a01031272e8\" (UID: \"e18c461e-7b4e-4c68-bffa-3a01031272e8\") "
Jul 28 19:54:04.660526 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.660489    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e18c461e-7b4e-4c68-bffa-3a01031272e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e18c461e-7b4e-4c68-bffa-3a01031272e8" (UID: "e18c461e-7b4e-4c68-bffa-3a01031272e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:54:04.662304 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.662274    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e18c461e-7b4e-4c68-bffa-3a01031272e8-kube-api-access-4cgmd" (OuterVolumeSpecName: "kube-api-access-4cgmd") pod "e18c461e-7b4e-4c68-bffa-3a01031272e8" (UID: "e18c461e-7b4e-4c68-bffa-3a01031272e8"). InnerVolumeSpecName "kube-api-access-4cgmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:54:04.761313 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.761287    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cgmd\" (UniqueName: \"kubernetes.io/projected/e18c461e-7b4e-4c68-bffa-3a01031272e8-kube-api-access-4cgmd\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:04.761313 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:04.761310    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e18c461e-7b4e-4c68-bffa-3a01031272e8-extensions-socket-volume\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:05.082820 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.082782    2575 generic.go:356] "Generic (PLEG): container finished" podID="e18c461e-7b4e-4c68-bffa-3a01031272e8" containerID="1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f" exitCode=0
Jul 28 19:54:05.083005 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.082834    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"
Jul 28 19:54:05.083005 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.082876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g" event={"ID":"e18c461e-7b4e-4c68-bffa-3a01031272e8","Type":"ContainerDied","Data":"1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f"}
Jul 28 19:54:05.083005 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.082961    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g" event={"ID":"e18c461e-7b4e-4c68-bffa-3a01031272e8","Type":"ContainerDied","Data":"587d57d059a3bdc311eb4e8b585b07cfd8b789c12d11c5d62b8a2dda4aa0d368"}
Jul 28 19:54:05.083005 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.082984    2575 scope.go:117] "RemoveContainer" containerID="1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f"
Jul 28 19:54:05.092898 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.092878    2575 scope.go:117] "RemoveContainer" containerID="1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f"
Jul 28 19:54:05.093220 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:05.093201    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f\": container with ID starting with 1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f not found: ID does not exist" containerID="1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f"
Jul 28 19:54:05.093280 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.093229    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f"} err="failed to get container status \"1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f\": rpc error: code = NotFound desc = could not find container \"1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f\": container with ID starting with 1686c3ccbda72438da72cb5e44fef6c71c74d2381292f4f5bcadcf983179df5f not found: ID does not exist"
Jul 28 19:54:05.104718 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.104680    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"]
Jul 28 19:54:05.118902 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.118863    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-82r9g"]
Jul 28 19:54:05.258976 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:05.258941    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e18c461e-7b4e-4c68-bffa-3a01031272e8" path="/var/lib/kubelet/pods/e18c461e-7b4e-4c68-bffa-3a01031272e8/volumes"
Jul 28 19:54:13.074978 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:13.074896    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hgpbv"
Jul 28 19:54:20.706631 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.706596    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"]
Jul 28 19:54:20.707009 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.706917    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e18c461e-7b4e-4c68-bffa-3a01031272e8" containerName="manager"
Jul 28 19:54:20.707009 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.706928    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e18c461e-7b4e-4c68-bffa-3a01031272e8" containerName="manager"
Jul 28 19:54:20.707009 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.706991    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e18c461e-7b4e-4c68-bffa-3a01031272e8" containerName="manager"
Jul 28 19:54:20.708966 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.708948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.711452 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.711428    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-82k8w\""
Jul 28 19:54:20.720600 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.720570    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"]
Jul 28 19:54:20.788359 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.788359 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.788593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.788593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.788593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whr6m\" (UniqueName: \"kubernetes.io/projected/81cbf011-0d2d-44aa-b31f-5144af101d24-kube-api-access-whr6m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.788593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.788593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.788798 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81cbf011-0d2d-44aa-b31f-5144af101d24-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.788798 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.788655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889428 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81cbf011-0d2d-44aa-b31f-5144af101d24-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.889713 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whr6m\" (UniqueName: \"kubernetes.io/projected/81cbf011-0d2d-44aa-b31f-5144af101d24-kube-api-access-whr6m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.890146 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.890146 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.889972    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.890286 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.890208    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.890286 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.890220    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.890286 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.890220    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81cbf011-0d2d-44aa-b31f-5144af101d24-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.892439 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.892405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.892553 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.892465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.897675 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.897638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81cbf011-0d2d-44aa-b31f-5144af101d24-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:20.897857 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:20.897834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whr6m\" (UniqueName: \"kubernetes.io/projected/81cbf011-0d2d-44aa-b31f-5144af101d24-kube-api-access-whr6m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zvf29\" (UID: \"81cbf011-0d2d-44aa-b31f-5144af101d24\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:21.019612 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:21.019579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:21.154429 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:21.154404    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"]
Jul 28 19:54:21.156899 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:21.156838    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81cbf011_0d2d_44aa_b31f_5144af101d24.slice/crio-fefef8c846a2eb8fcc694db475e1a9ab27c673f2cb354db6658cdcf80af91f4e WatchSource:0}: Error finding container fefef8c846a2eb8fcc694db475e1a9ab27c673f2cb354db6658cdcf80af91f4e: Status 404 returned error can't find the container with id fefef8c846a2eb8fcc694db475e1a9ab27c673f2cb354db6658cdcf80af91f4e
Jul 28 19:54:21.159499 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:21.159457    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:54:21.159586 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:21.159540    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:54:21.159625 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:21.159610    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:54:22.166090 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:22.166051    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" event={"ID":"81cbf011-0d2d-44aa-b31f-5144af101d24","Type":"ContainerStarted","Data":"5e48136b28273115abc0de008b0ce8c2d1a5975e7269ad539e2ff781d8419fcc"}
Jul 28 19:54:22.166512 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:22.166115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" event={"ID":"81cbf011-0d2d-44aa-b31f-5144af101d24","Type":"ContainerStarted","Data":"fefef8c846a2eb8fcc694db475e1a9ab27c673f2cb354db6658cdcf80af91f4e"}
Jul 28 19:54:22.188848 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:22.188798    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" podStartSLOduration=2.188780597 podStartE2EDuration="2.188780597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:22.186718466 +0000 UTC m=+453.555855575" watchObservedRunningTime="2026-07-28 19:54:22.188780597 +0000 UTC m=+453.557917707"
Jul 28 19:54:23.019982 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.019932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:23.024898 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.024869    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:23.170717 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.170684    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:23.171857 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.171837    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:54:23.245563 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.245532    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"]
Jul 28 19:54:23.247827 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.247810    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:23.250304 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.250280    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 19:54:23.265601 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.265569    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"]
Jul 28 19:54:23.312217 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.312088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48df5\" (UniqueName: \"kubernetes.io/projected/2e45b147-8892-4e05-b1b8-3c096e646728-kube-api-access-48df5\") pod \"limitador-limitador-64c94fd64f-hwgl7\" (UID: \"2e45b147-8892-4e05-b1b8-3c096e646728\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:23.312217 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.312140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e45b147-8892-4e05-b1b8-3c096e646728-config-file\") pod \"limitador-limitador-64c94fd64f-hwgl7\" (UID: \"2e45b147-8892-4e05-b1b8-3c096e646728\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:23.350505 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.350460    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"]
Jul 28 19:54:23.412938 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.412896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48df5\" (UniqueName: \"kubernetes.io/projected/2e45b147-8892-4e05-b1b8-3c096e646728-kube-api-access-48df5\") pod \"limitador-limitador-64c94fd64f-hwgl7\" (UID: \"2e45b147-8892-4e05-b1b8-3c096e646728\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:23.412938 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.412946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e45b147-8892-4e05-b1b8-3c096e646728-config-file\") pod \"limitador-limitador-64c94fd64f-hwgl7\" (UID: \"2e45b147-8892-4e05-b1b8-3c096e646728\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:23.413627 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.413608    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e45b147-8892-4e05-b1b8-3c096e646728-config-file\") pod \"limitador-limitador-64c94fd64f-hwgl7\" (UID: \"2e45b147-8892-4e05-b1b8-3c096e646728\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:23.421105 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.421078    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48df5\" (UniqueName: \"kubernetes.io/projected/2e45b147-8892-4e05-b1b8-3c096e646728-kube-api-access-48df5\") pod \"limitador-limitador-64c94fd64f-hwgl7\" (UID: \"2e45b147-8892-4e05-b1b8-3c096e646728\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:23.560768 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.560719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:23.700904 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:23.700874    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"]
Jul 28 19:54:23.703609 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:23.703580    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e45b147_8892_4e05_b1b8_3c096e646728.slice/crio-8b043ff0f80447c64f94007ffbdc2884b1f54f6e20e31979427770017031fd57 WatchSource:0}: Error finding container 8b043ff0f80447c64f94007ffbdc2884b1f54f6e20e31979427770017031fd57: Status 404 returned error can't find the container with id 8b043ff0f80447c64f94007ffbdc2884b1f54f6e20e31979427770017031fd57
Jul 28 19:54:24.065724 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.065680    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6zxqz"]
Jul 28 19:54:24.072804 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.072762    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6zxqz"
Jul 28 19:54:24.075535 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.075485    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-thzgt\""
Jul 28 19:54:24.077541 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.077510    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6zxqz"]
Jul 28 19:54:24.118674 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.118631    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q2xv\" (UniqueName: \"kubernetes.io/projected/cc3679a1-c468-4250-95fd-8a285f012f90-kube-api-access-2q2xv\") pod \"authorino-58cd955675-6zxqz\" (UID: \"cc3679a1-c468-4250-95fd-8a285f012f90\") " pod="kuadrant-system/authorino-58cd955675-6zxqz"
Jul 28 19:54:24.176412 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.176378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7" event={"ID":"2e45b147-8892-4e05-b1b8-3c096e646728","Type":"ContainerStarted","Data":"8b043ff0f80447c64f94007ffbdc2884b1f54f6e20e31979427770017031fd57"}
Jul 28 19:54:24.219580 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.219549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q2xv\" (UniqueName: \"kubernetes.io/projected/cc3679a1-c468-4250-95fd-8a285f012f90-kube-api-access-2q2xv\") pod \"authorino-58cd955675-6zxqz\" (UID: \"cc3679a1-c468-4250-95fd-8a285f012f90\") " pod="kuadrant-system/authorino-58cd955675-6zxqz"
Jul 28 19:54:24.229557 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.229523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q2xv\" (UniqueName: \"kubernetes.io/projected/cc3679a1-c468-4250-95fd-8a285f012f90-kube-api-access-2q2xv\") pod \"authorino-58cd955675-6zxqz\" (UID: \"cc3679a1-c468-4250-95fd-8a285f012f90\") " pod="kuadrant-system/authorino-58cd955675-6zxqz"
Jul 28 19:54:24.369162 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.369063    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpcx5"]
Jul 28 19:54:24.379587 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.379545    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fpcx5"
Jul 28 19:54:24.381735 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.381704    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpcx5"]
Jul 28 19:54:24.383608 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.383583    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6zxqz"
Jul 28 19:54:24.421379 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.421332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8grd\" (UniqueName: \"kubernetes.io/projected/fe75e274-5d29-4641-9d43-347f26fac385-kube-api-access-m8grd\") pod \"authorino-75d556bd77-fpcx5\" (UID: \"fe75e274-5d29-4641-9d43-347f26fac385\") " pod="kuadrant-system/authorino-75d556bd77-fpcx5"
Jul 28 19:54:24.522866 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.522822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8grd\" (UniqueName: \"kubernetes.io/projected/fe75e274-5d29-4641-9d43-347f26fac385-kube-api-access-m8grd\") pod \"authorino-75d556bd77-fpcx5\" (UID: \"fe75e274-5d29-4641-9d43-347f26fac385\") " pod="kuadrant-system/authorino-75d556bd77-fpcx5"
Jul 28 19:54:24.526018 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.525986    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6zxqz"]
Jul 28 19:54:24.529891 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:24.529859    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc3679a1_c468_4250_95fd_8a285f012f90.slice/crio-4416f227959b90b0e22cae161a3f7bf2d609939a36985072c7e44efe6634ad63 WatchSource:0}: Error finding container 4416f227959b90b0e22cae161a3f7bf2d609939a36985072c7e44efe6634ad63: Status 404 returned error can't find the container with id 4416f227959b90b0e22cae161a3f7bf2d609939a36985072c7e44efe6634ad63
Jul 28 19:54:24.531120 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.531096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8grd\" (UniqueName: \"kubernetes.io/projected/fe75e274-5d29-4641-9d43-347f26fac385-kube-api-access-m8grd\") pod \"authorino-75d556bd77-fpcx5\" (UID: \"fe75e274-5d29-4641-9d43-347f26fac385\") " pod="kuadrant-system/authorino-75d556bd77-fpcx5"
Jul 28 19:54:24.691339 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.691246    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fpcx5"
Jul 28 19:54:24.845475 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:24.845427    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpcx5"]
Jul 28 19:54:24.848442 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:24.848405    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe75e274_5d29_4641_9d43_347f26fac385.slice/crio-98f6884626886abe46cd3e5faec749702f3d8c5e817ab873db72604f29fe8dbc WatchSource:0}: Error finding container 98f6884626886abe46cd3e5faec749702f3d8c5e817ab873db72604f29fe8dbc: Status 404 returned error can't find the container with id 98f6884626886abe46cd3e5faec749702f3d8c5e817ab873db72604f29fe8dbc
Jul 28 19:54:25.183837 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:25.183798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6zxqz" event={"ID":"cc3679a1-c468-4250-95fd-8a285f012f90","Type":"ContainerStarted","Data":"4416f227959b90b0e22cae161a3f7bf2d609939a36985072c7e44efe6634ad63"}
Jul 28 19:54:25.185161 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:25.185133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fpcx5" event={"ID":"fe75e274-5d29-4641-9d43-347f26fac385","Type":"ContainerStarted","Data":"98f6884626886abe46cd3e5faec749702f3d8c5e817ab873db72604f29fe8dbc"}
Jul 28 19:54:30.219123 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:30.219066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7" event={"ID":"2e45b147-8892-4e05-b1b8-3c096e646728","Type":"ContainerStarted","Data":"ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535"}
Jul 28 19:54:30.219637 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:30.219201    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:30.221591 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:30.221556    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6zxqz" event={"ID":"cc3679a1-c468-4250-95fd-8a285f012f90","Type":"ContainerStarted","Data":"58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead"}
Jul 28 19:54:30.223368 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:30.223337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fpcx5" event={"ID":"fe75e274-5d29-4641-9d43-347f26fac385","Type":"ContainerStarted","Data":"8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9"}
Jul 28 19:54:30.236270 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:30.236216    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7" podStartSLOduration=1.476927175 podStartE2EDuration="7.236199236s" totalImagesPullingTime="5.759272061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:30.235126794 +0000 UTC m=+461.604263908" watchObservedRunningTime="2026-07-28 19:54:30.236199236 +0000 UTC m=+461.605336346"
Jul 28 19:54:30.249295 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:30.249215    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6zxqz" podStartSLOduration=1.3039803110000001 podStartE2EDuration="6.24919121s" totalImagesPullingTime="4.945210899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:30.248564014 +0000 UTC m=+461.617701122" watchObservedRunningTime="2026-07-28 19:54:30.24919121 +0000 UTC m=+461.618328316"
Jul 28 19:54:30.268299 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:30.268226    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fpcx5" podStartSLOduration=1.65173964 podStartE2EDuration="6.26820046s" totalImagesPullingTime="4.61646082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:30.266357424 +0000 UTC m=+461.635494534" watchObservedRunningTime="2026-07-28 19:54:30.26820046 +0000 UTC m=+461.637337573"
Jul 28 19:54:30.294023 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:30.293979    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6zxqz"]
Jul 28 19:54:32.235484 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:32.235443    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6zxqz" podUID="cc3679a1-c468-4250-95fd-8a285f012f90" containerName="authorino" containerID="cri-o://58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead" gracePeriod=30
Jul 28 19:54:32.484430 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:32.484399    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6zxqz"
Jul 28 19:54:32.602005 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:32.601906    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q2xv\" (UniqueName: \"kubernetes.io/projected/cc3679a1-c468-4250-95fd-8a285f012f90-kube-api-access-2q2xv\") pod \"cc3679a1-c468-4250-95fd-8a285f012f90\" (UID: \"cc3679a1-c468-4250-95fd-8a285f012f90\") "
Jul 28 19:54:32.604303 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:32.604271    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc3679a1-c468-4250-95fd-8a285f012f90-kube-api-access-2q2xv" (OuterVolumeSpecName: "kube-api-access-2q2xv") pod "cc3679a1-c468-4250-95fd-8a285f012f90" (UID: "cc3679a1-c468-4250-95fd-8a285f012f90"). InnerVolumeSpecName "kube-api-access-2q2xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:54:32.702897 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:32.702860    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q2xv\" (UniqueName: \"kubernetes.io/projected/cc3679a1-c468-4250-95fd-8a285f012f90-kube-api-access-2q2xv\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:33.241672 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.241632    2575 generic.go:356] "Generic (PLEG): container finished" podID="cc3679a1-c468-4250-95fd-8a285f012f90" containerID="58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead" exitCode=0
Jul 28 19:54:33.242101 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.241701    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6zxqz"
Jul 28 19:54:33.242101 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.241724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6zxqz" event={"ID":"cc3679a1-c468-4250-95fd-8a285f012f90","Type":"ContainerDied","Data":"58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead"}
Jul 28 19:54:33.242101 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.241766    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6zxqz" event={"ID":"cc3679a1-c468-4250-95fd-8a285f012f90","Type":"ContainerDied","Data":"4416f227959b90b0e22cae161a3f7bf2d609939a36985072c7e44efe6634ad63"}
Jul 28 19:54:33.242101 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.241784    2575 scope.go:117] "RemoveContainer" containerID="58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead"
Jul 28 19:54:33.250187 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.250146    2575 scope.go:117] "RemoveContainer" containerID="58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead"
Jul 28 19:54:33.250440 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:33.250423    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead\": container with ID starting with 58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead not found: ID does not exist" containerID="58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead"
Jul 28 19:54:33.250481 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.250449    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead"} err="failed to get container status \"58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead\": rpc error: code = NotFound desc = could not find container \"58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead\": container with ID starting with 58ba51d0c7e377e091bc8cbe451da1c1a0d2441aaaec676e1dc26a7094474ead not found: ID does not exist"
Jul 28 19:54:33.261512 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.261490    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6zxqz"]
Jul 28 19:54:33.265339 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:33.265320    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6zxqz"]
Jul 28 19:54:35.257095 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:35.257060    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc3679a1-c468-4250-95fd-8a285f012f90" path="/var/lib/kubelet/pods/cc3679a1-c468-4250-95fd-8a285f012f90/volumes"
Jul 28 19:54:39.052653 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.052615    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"]
Jul 28 19:54:39.053049 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.052795    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7" podUID="2e45b147-8892-4e05-b1b8-3c096e646728" containerName="limitador" containerID="cri-o://ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535" gracePeriod=30
Jul 28 19:54:39.054884 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.054863    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:39.615744 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.615672    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:39.773767 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.773731    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48df5\" (UniqueName: \"kubernetes.io/projected/2e45b147-8892-4e05-b1b8-3c096e646728-kube-api-access-48df5\") pod \"2e45b147-8892-4e05-b1b8-3c096e646728\" (UID: \"2e45b147-8892-4e05-b1b8-3c096e646728\") "
Jul 28 19:54:39.773963 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.773797    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e45b147-8892-4e05-b1b8-3c096e646728-config-file\") pod \"2e45b147-8892-4e05-b1b8-3c096e646728\" (UID: \"2e45b147-8892-4e05-b1b8-3c096e646728\") "
Jul 28 19:54:39.774248 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.774225    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e45b147-8892-4e05-b1b8-3c096e646728-config-file" (OuterVolumeSpecName: "config-file") pod "2e45b147-8892-4e05-b1b8-3c096e646728" (UID: "2e45b147-8892-4e05-b1b8-3c096e646728"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:54:39.776081 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.776043    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e45b147-8892-4e05-b1b8-3c096e646728-kube-api-access-48df5" (OuterVolumeSpecName: "kube-api-access-48df5") pod "2e45b147-8892-4e05-b1b8-3c096e646728" (UID: "2e45b147-8892-4e05-b1b8-3c096e646728"). InnerVolumeSpecName "kube-api-access-48df5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:54:39.875102 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.875008    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48df5\" (UniqueName: \"kubernetes.io/projected/2e45b147-8892-4e05-b1b8-3c096e646728-kube-api-access-48df5\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:39.875102 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:39.875043    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e45b147-8892-4e05-b1b8-3c096e646728-config-file\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:40.275330 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.275290    2575 generic.go:356] "Generic (PLEG): container finished" podID="2e45b147-8892-4e05-b1b8-3c096e646728" containerID="ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535" exitCode=0
Jul 28 19:54:40.275330 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.275331    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"
Jul 28 19:54:40.275819 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.275368    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7" event={"ID":"2e45b147-8892-4e05-b1b8-3c096e646728","Type":"ContainerDied","Data":"ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535"}
Jul 28 19:54:40.275819 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.275428    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hwgl7" event={"ID":"2e45b147-8892-4e05-b1b8-3c096e646728","Type":"ContainerDied","Data":"8b043ff0f80447c64f94007ffbdc2884b1f54f6e20e31979427770017031fd57"}
Jul 28 19:54:40.275819 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.275465    2575 scope.go:117] "RemoveContainer" containerID="ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535"
Jul 28 19:54:40.284536 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.284518    2575 scope.go:117] "RemoveContainer" containerID="ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535"
Jul 28 19:54:40.284885 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:54:40.284860    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535\": container with ID starting with ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535 not found: ID does not exist" containerID="ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535"
Jul 28 19:54:40.284931 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.284892    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535"} err="failed to get container status \"ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535\": rpc error: code = NotFound desc = could not find container \"ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535\": container with ID starting with ed21744a688a749478a22dc8df5329a6146d8fc4baf65460fc1d94b5c7bb6535 not found: ID does not exist"
Jul 28 19:54:40.296821 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.296791    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"]
Jul 28 19:54:40.298321 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:40.298297    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hwgl7"]
Jul 28 19:54:41.257829 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:41.257796    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e45b147-8892-4e05-b1b8-3c096e646728" path="/var/lib/kubelet/pods/2e45b147-8892-4e05-b1b8-3c096e646728/volumes"
Jul 28 19:54:45.131643 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.131610    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"]
Jul 28 19:54:45.132036 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.131941    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e45b147-8892-4e05-b1b8-3c096e646728" containerName="limitador"
Jul 28 19:54:45.132036 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.131951    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e45b147-8892-4e05-b1b8-3c096e646728" containerName="limitador"
Jul 28 19:54:45.132036 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.131968    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc3679a1-c468-4250-95fd-8a285f012f90" containerName="authorino"
Jul 28 19:54:45.132036 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.131973    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc3679a1-c468-4250-95fd-8a285f012f90" containerName="authorino"
Jul 28 19:54:45.132036 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.132022    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc3679a1-c468-4250-95fd-8a285f012f90" containerName="authorino"
Jul 28 19:54:45.132036 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.132032    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e45b147-8892-4e05-b1b8-3c096e646728" containerName="limitador"
Jul 28 19:54:45.134111 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.134090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:45.136809 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.136789    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 19:54:45.136937 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.136789    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 19:54:45.137871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.137851    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 19:54:45.138028 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.138008    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-29htx\""
Jul 28 19:54:45.144877 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.144835    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"]
Jul 28 19:54:45.224800 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.224765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/632dcd72-111a-497c-97fa-aae4ea3d5fdd-data\") pod \"postgres-69fb4594cf-jpmcv\" (UID: \"632dcd72-111a-497c-97fa-aae4ea3d5fdd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:45.224998 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.224831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94sbm\" (UniqueName: \"kubernetes.io/projected/632dcd72-111a-497c-97fa-aae4ea3d5fdd-kube-api-access-94sbm\") pod \"postgres-69fb4594cf-jpmcv\" (UID: \"632dcd72-111a-497c-97fa-aae4ea3d5fdd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:45.325963 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.325919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/632dcd72-111a-497c-97fa-aae4ea3d5fdd-data\") pod \"postgres-69fb4594cf-jpmcv\" (UID: \"632dcd72-111a-497c-97fa-aae4ea3d5fdd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:45.326218 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.325990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94sbm\" (UniqueName: \"kubernetes.io/projected/632dcd72-111a-497c-97fa-aae4ea3d5fdd-kube-api-access-94sbm\") pod \"postgres-69fb4594cf-jpmcv\" (UID: \"632dcd72-111a-497c-97fa-aae4ea3d5fdd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:45.326418 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.326396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/632dcd72-111a-497c-97fa-aae4ea3d5fdd-data\") pod \"postgres-69fb4594cf-jpmcv\" (UID: \"632dcd72-111a-497c-97fa-aae4ea3d5fdd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:45.334852 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.334819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94sbm\" (UniqueName: \"kubernetes.io/projected/632dcd72-111a-497c-97fa-aae4ea3d5fdd-kube-api-access-94sbm\") pod \"postgres-69fb4594cf-jpmcv\" (UID: \"632dcd72-111a-497c-97fa-aae4ea3d5fdd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:45.446376 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.446279    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:45.604785 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:45.604746    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"]
Jul 28 19:54:45.614003 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:45.613973    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632dcd72_111a_497c_97fa_aae4ea3d5fdd.slice/crio-e75f3dc3e769a849fce7cc9b1ef2325deee7670c48b4670698347c26f143e41e WatchSource:0}: Error finding container e75f3dc3e769a849fce7cc9b1ef2325deee7670c48b4670698347c26f143e41e: Status 404 returned error can't find the container with id e75f3dc3e769a849fce7cc9b1ef2325deee7670c48b4670698347c26f143e41e
Jul 28 19:54:46.304439 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:46.304403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv" event={"ID":"632dcd72-111a-497c-97fa-aae4ea3d5fdd","Type":"ContainerStarted","Data":"e75f3dc3e769a849fce7cc9b1ef2325deee7670c48b4670698347c26f143e41e"}
Jul 28 19:54:50.608254 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:50.608210    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 19:54:51.335535 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:51.335496    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv" event={"ID":"632dcd72-111a-497c-97fa-aae4ea3d5fdd","Type":"ContainerStarted","Data":"874e46eb597d6cace161fc9de8e82c89d9be94473b4636ffb6907ddfdadf20cc"}
Jul 28 19:54:51.335736 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:51.335645    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:51.351034 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:51.350973    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv" podStartSLOduration=1.361614798 podStartE2EDuration="6.350957501s" totalImagesPullingTime="4.989342703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:51.349633847 +0000 UTC m=+482.718770957" watchObservedRunningTime="2026-07-28 19:54:51.350957501 +0000 UTC m=+482.720094610"
Jul 28 19:54:57.370389 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:57.370357    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jpmcv"
Jul 28 19:54:57.940108 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:57.940072    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6fvn"]
Jul 28 19:54:57.946837 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:57.946803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r6fvn"
Jul 28 19:54:57.949673 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:57.949644    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6fvn"]
Jul 28 19:54:58.042479 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.042420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glz9p\" (UniqueName: \"kubernetes.io/projected/1921fc76-5e69-4a17-b00d-34474a09473b-kube-api-access-glz9p\") pod \"authorino-5d4b67c446-r6fvn\" (UID: \"1921fc76-5e69-4a17-b00d-34474a09473b\") " pod="kuadrant-system/authorino-5d4b67c446-r6fvn"
Jul 28 19:54:58.143366 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.143319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glz9p\" (UniqueName: \"kubernetes.io/projected/1921fc76-5e69-4a17-b00d-34474a09473b-kube-api-access-glz9p\") pod \"authorino-5d4b67c446-r6fvn\" (UID: \"1921fc76-5e69-4a17-b00d-34474a09473b\") " pod="kuadrant-system/authorino-5d4b67c446-r6fvn"
Jul 28 19:54:58.151659 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.151630    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glz9p\" (UniqueName: \"kubernetes.io/projected/1921fc76-5e69-4a17-b00d-34474a09473b-kube-api-access-glz9p\") pod \"authorino-5d4b67c446-r6fvn\" (UID: \"1921fc76-5e69-4a17-b00d-34474a09473b\") " pod="kuadrant-system/authorino-5d4b67c446-r6fvn"
Jul 28 19:54:58.184275 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.184235    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6fvn"]
Jul 28 19:54:58.184553 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.184541    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r6fvn"
Jul 28 19:54:58.211512 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.211474    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dd5f8dc66-b4g5t"]
Jul 28 19:54:58.216864 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.216832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t"
Jul 28 19:54:58.222734 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.222701    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd5f8dc66-b4g5t"]
Jul 28 19:54:58.244366 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.244335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd6pr\" (UniqueName: \"kubernetes.io/projected/f7ece3e4-7456-4989-91b7-55db406ed0ee-kube-api-access-jd6pr\") pod \"authorino-6dd5f8dc66-b4g5t\" (UID: \"f7ece3e4-7456-4989-91b7-55db406ed0ee\") " pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t"
Jul 28 19:54:58.336378 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.336303    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6fvn"]
Jul 28 19:54:58.339455 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:58.339422    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1921fc76_5e69_4a17_b00d_34474a09473b.slice/crio-e0c1412435ddf5850ef458f0b51963c5d4f036bfea60c067f60dddbc8cfa96ca WatchSource:0}: Error finding container e0c1412435ddf5850ef458f0b51963c5d4f036bfea60c067f60dddbc8cfa96ca: Status 404 returned error can't find the container with id e0c1412435ddf5850ef458f0b51963c5d4f036bfea60c067f60dddbc8cfa96ca
Jul 28 19:54:58.345113 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.345078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd6pr\" (UniqueName: \"kubernetes.io/projected/f7ece3e4-7456-4989-91b7-55db406ed0ee-kube-api-access-jd6pr\") pod \"authorino-6dd5f8dc66-b4g5t\" (UID: \"f7ece3e4-7456-4989-91b7-55db406ed0ee\") " pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t"
Jul 28 19:54:58.355611 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.355568    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd6pr\" (UniqueName: \"kubernetes.io/projected/f7ece3e4-7456-4989-91b7-55db406ed0ee-kube-api-access-jd6pr\") pod \"authorino-6dd5f8dc66-b4g5t\" (UID: \"f7ece3e4-7456-4989-91b7-55db406ed0ee\") " pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t"
Jul 28 19:54:58.370414 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.370378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r6fvn" event={"ID":"1921fc76-5e69-4a17-b00d-34474a09473b","Type":"ContainerStarted","Data":"e0c1412435ddf5850ef458f0b51963c5d4f036bfea60c067f60dddbc8cfa96ca"}
Jul 28 19:54:58.383782 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.383750    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd5f8dc66-b4g5t"]
Jul 28 19:54:58.384021 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.384010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t"
Jul 28 19:54:58.412849 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.412815    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b69854658-dr2t2"]
Jul 28 19:54:58.445216 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.445102    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b69854658-dr2t2"]
Jul 28 19:54:58.445368 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.445240    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:54:58.448139 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.447788    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 19:54:58.546438 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.546405    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd5f8dc66-b4g5t"]
Jul 28 19:54:58.546794 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.546772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k5wk\" (UniqueName: \"kubernetes.io/projected/db031038-ee19-45b6-a741-82e982cb5fba-kube-api-access-2k5wk\") pod \"authorino-6b69854658-dr2t2\" (UID: \"db031038-ee19-45b6-a741-82e982cb5fba\") " pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:54:58.546880 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.546868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db031038-ee19-45b6-a741-82e982cb5fba-tls-cert\") pod \"authorino-6b69854658-dr2t2\" (UID: \"db031038-ee19-45b6-a741-82e982cb5fba\") " pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:54:58.548764 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:58.548734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7ece3e4_7456_4989_91b7_55db406ed0ee.slice/crio-2b07a1e09638958e96858a5ace3af38584d4fabfa539058383608d7242736437 WatchSource:0}: Error finding container 2b07a1e09638958e96858a5ace3af38584d4fabfa539058383608d7242736437: Status 404 returned error can't find the container with id 2b07a1e09638958e96858a5ace3af38584d4fabfa539058383608d7242736437
Jul 28 19:54:58.647863 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.647820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db031038-ee19-45b6-a741-82e982cb5fba-tls-cert\") pod \"authorino-6b69854658-dr2t2\" (UID: \"db031038-ee19-45b6-a741-82e982cb5fba\") " pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:54:58.648043 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.647888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k5wk\" (UniqueName: \"kubernetes.io/projected/db031038-ee19-45b6-a741-82e982cb5fba-kube-api-access-2k5wk\") pod \"authorino-6b69854658-dr2t2\" (UID: \"db031038-ee19-45b6-a741-82e982cb5fba\") " pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:54:58.650693 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.650666    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db031038-ee19-45b6-a741-82e982cb5fba-tls-cert\") pod \"authorino-6b69854658-dr2t2\" (UID: \"db031038-ee19-45b6-a741-82e982cb5fba\") " pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:54:58.656641 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.656617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k5wk\" (UniqueName: \"kubernetes.io/projected/db031038-ee19-45b6-a741-82e982cb5fba-kube-api-access-2k5wk\") pod \"authorino-6b69854658-dr2t2\" (UID: \"db031038-ee19-45b6-a741-82e982cb5fba\") " pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:54:58.756619 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.756582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:54:58.919143 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:58.919116    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b69854658-dr2t2"]
Jul 28 19:54:58.921224 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:54:58.921189    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb031038_ee19_45b6_a741_82e982cb5fba.slice/crio-2a92eb423e1812ac87b3ab8da714485aeaaf9683cdfa3b819e4e29b38a36e91e WatchSource:0}: Error finding container 2a92eb423e1812ac87b3ab8da714485aeaaf9683cdfa3b819e4e29b38a36e91e: Status 404 returned error can't find the container with id 2a92eb423e1812ac87b3ab8da714485aeaaf9683cdfa3b819e4e29b38a36e91e
Jul 28 19:54:59.383597 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.383509    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b69854658-dr2t2" event={"ID":"db031038-ee19-45b6-a741-82e982cb5fba","Type":"ContainerStarted","Data":"2a92eb423e1812ac87b3ab8da714485aeaaf9683cdfa3b819e4e29b38a36e91e"}
Jul 28 19:54:59.385414 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.385375    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r6fvn" event={"ID":"1921fc76-5e69-4a17-b00d-34474a09473b","Type":"ContainerStarted","Data":"c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1"}
Jul 28 19:54:59.385590 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.385492    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-r6fvn" podUID="1921fc76-5e69-4a17-b00d-34474a09473b" containerName="authorino" containerID="cri-o://c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1" gracePeriod=30
Jul 28 19:54:59.387551 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.387515    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t" event={"ID":"f7ece3e4-7456-4989-91b7-55db406ed0ee","Type":"ContainerStarted","Data":"21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06"}
Jul 28 19:54:59.387669 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.387553    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t" podUID="f7ece3e4-7456-4989-91b7-55db406ed0ee" containerName="authorino" containerID="cri-o://21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06" gracePeriod=30
Jul 28 19:54:59.387669 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.387562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t" event={"ID":"f7ece3e4-7456-4989-91b7-55db406ed0ee","Type":"ContainerStarted","Data":"2b07a1e09638958e96858a5ace3af38584d4fabfa539058383608d7242736437"}
Jul 28 19:54:59.400564 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.400508    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-r6fvn" podStartSLOduration=1.662953083 podStartE2EDuration="2.400487245s" totalImagesPullingTime="737.534162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:59.399831959 +0000 UTC m=+490.768969082" watchObservedRunningTime="2026-07-28 19:54:59.400487245 +0000 UTC m=+490.769624358"
Jul 28 19:54:59.415123 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.415073    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t" podStartSLOduration=0.796018325 podStartE2EDuration="1.415055498s" totalImagesPullingTime="619.037173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:54:59.41418158 +0000 UTC m=+490.783318685" watchObservedRunningTime="2026-07-28 19:54:59.415055498 +0000 UTC m=+490.784192608"
Jul 28 19:54:59.695215 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.695162    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r6fvn"
Jul 28 19:54:59.727874 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.727840    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t"
Jul 28 19:54:59.757341 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.757302    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd6pr\" (UniqueName: \"kubernetes.io/projected/f7ece3e4-7456-4989-91b7-55db406ed0ee-kube-api-access-jd6pr\") pod \"f7ece3e4-7456-4989-91b7-55db406ed0ee\" (UID: \"f7ece3e4-7456-4989-91b7-55db406ed0ee\") "
Jul 28 19:54:59.757558 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.757385    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glz9p\" (UniqueName: \"kubernetes.io/projected/1921fc76-5e69-4a17-b00d-34474a09473b-kube-api-access-glz9p\") pod \"1921fc76-5e69-4a17-b00d-34474a09473b\" (UID: \"1921fc76-5e69-4a17-b00d-34474a09473b\") "
Jul 28 19:54:59.759648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.759620    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1921fc76-5e69-4a17-b00d-34474a09473b-kube-api-access-glz9p" (OuterVolumeSpecName: "kube-api-access-glz9p") pod "1921fc76-5e69-4a17-b00d-34474a09473b" (UID: "1921fc76-5e69-4a17-b00d-34474a09473b"). InnerVolumeSpecName "kube-api-access-glz9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:54:59.759754 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.759616    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ece3e4-7456-4989-91b7-55db406ed0ee-kube-api-access-jd6pr" (OuterVolumeSpecName: "kube-api-access-jd6pr") pod "f7ece3e4-7456-4989-91b7-55db406ed0ee" (UID: "f7ece3e4-7456-4989-91b7-55db406ed0ee"). InnerVolumeSpecName "kube-api-access-jd6pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:54:59.858274 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.858238    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glz9p\" (UniqueName: \"kubernetes.io/projected/1921fc76-5e69-4a17-b00d-34474a09473b-kube-api-access-glz9p\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:54:59.858274 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:54:59.858270    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd6pr\" (UniqueName: \"kubernetes.io/projected/f7ece3e4-7456-4989-91b7-55db406ed0ee-kube-api-access-jd6pr\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:55:00.394291 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.394244    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b69854658-dr2t2" event={"ID":"db031038-ee19-45b6-a741-82e982cb5fba","Type":"ContainerStarted","Data":"3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6"}
Jul 28 19:55:00.395472 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.395447    2575 generic.go:356] "Generic (PLEG): container finished" podID="1921fc76-5e69-4a17-b00d-34474a09473b" containerID="c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1" exitCode=0
Jul 28 19:55:00.395609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.395504    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r6fvn"
Jul 28 19:55:00.395609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.395512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r6fvn" event={"ID":"1921fc76-5e69-4a17-b00d-34474a09473b","Type":"ContainerDied","Data":"c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1"}
Jul 28 19:55:00.395609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.395540    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r6fvn" event={"ID":"1921fc76-5e69-4a17-b00d-34474a09473b","Type":"ContainerDied","Data":"e0c1412435ddf5850ef458f0b51963c5d4f036bfea60c067f60dddbc8cfa96ca"}
Jul 28 19:55:00.395609 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.395556    2575 scope.go:117] "RemoveContainer" containerID="c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1"
Jul 28 19:55:00.396809 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.396786    2575 generic.go:356] "Generic (PLEG): container finished" podID="f7ece3e4-7456-4989-91b7-55db406ed0ee" containerID="21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06" exitCode=0
Jul 28 19:55:00.396875 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.396832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t" event={"ID":"f7ece3e4-7456-4989-91b7-55db406ed0ee","Type":"ContainerDied","Data":"21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06"}
Jul 28 19:55:00.396875 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.396858    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t"
Jul 28 19:55:00.396965 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.396859    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dd5f8dc66-b4g5t" event={"ID":"f7ece3e4-7456-4989-91b7-55db406ed0ee","Type":"ContainerDied","Data":"2b07a1e09638958e96858a5ace3af38584d4fabfa539058383608d7242736437"}
Jul 28 19:55:00.405035 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.405010    2575 scope.go:117] "RemoveContainer" containerID="c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1"
Jul 28 19:55:00.405543 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:55:00.405505    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1\": container with ID starting with c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1 not found: ID does not exist" containerID="c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1"
Jul 28 19:55:00.405668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.405545    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1"} err="failed to get container status \"c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1\": rpc error: code = NotFound desc = could not find container \"c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1\": container with ID starting with c193c09cb4ba67fcd632a194869612802e5294f6806c192751836c4a8d0532c1 not found: ID does not exist"
Jul 28 19:55:00.405668 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.405566    2575 scope.go:117] "RemoveContainer" containerID="21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06"
Jul 28 19:55:00.411900 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.411841    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b69854658-dr2t2" podStartSLOduration=1.878711861 podStartE2EDuration="2.411825247s" totalImagesPullingTime="533.113386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:55:00.408802999 +0000 UTC m=+491.777940100" watchObservedRunningTime="2026-07-28 19:55:00.411825247 +0000 UTC m=+491.780962358"
Jul 28 19:55:00.415250 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.415232    2575 scope.go:117] "RemoveContainer" containerID="21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06"
Jul 28 19:55:00.415565 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:55:00.415545    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06\": container with ID starting with 21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06 not found: ID does not exist" containerID="21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06"
Jul 28 19:55:00.415641 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.415574    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06"} err="failed to get container status \"21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06\": rpc error: code = NotFound desc = could not find container \"21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06\": container with ID starting with 21f91653472341a579fb9bb201ae5f7d4110c4f17aa587cf07de2b1004887e06 not found: ID does not exist"
Jul 28 19:55:00.425719 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.425677    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6fvn"]
Jul 28 19:55:00.427498 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.427470    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r6fvn"]
Jul 28 19:55:00.436739 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.436704    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpcx5"]
Jul 28 19:55:00.436926 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.436902    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fpcx5" podUID="fe75e274-5d29-4641-9d43-347f26fac385" containerName="authorino" containerID="cri-o://8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9" gracePeriod=30
Jul 28 19:55:00.439868 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.439847    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd5f8dc66-b4g5t"]
Jul 28 19:55:00.447693 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.447660    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dd5f8dc66-b4g5t"]
Jul 28 19:55:00.748590 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.748556    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fpcx5"
Jul 28 19:55:00.872895 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.872855    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8grd\" (UniqueName: \"kubernetes.io/projected/fe75e274-5d29-4641-9d43-347f26fac385-kube-api-access-m8grd\") pod \"fe75e274-5d29-4641-9d43-347f26fac385\" (UID: \"fe75e274-5d29-4641-9d43-347f26fac385\") "
Jul 28 19:55:00.875518 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.875481    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe75e274-5d29-4641-9d43-347f26fac385-kube-api-access-m8grd" (OuterVolumeSpecName: "kube-api-access-m8grd") pod "fe75e274-5d29-4641-9d43-347f26fac385" (UID: "fe75e274-5d29-4641-9d43-347f26fac385"). InnerVolumeSpecName "kube-api-access-m8grd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:55:00.974457 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:00.974372    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8grd\" (UniqueName: \"kubernetes.io/projected/fe75e274-5d29-4641-9d43-347f26fac385-kube-api-access-m8grd\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:55:01.268868 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.268824    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1921fc76-5e69-4a17-b00d-34474a09473b" path="/var/lib/kubelet/pods/1921fc76-5e69-4a17-b00d-34474a09473b/volumes"
Jul 28 19:55:01.269185 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.269156    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7ece3e4-7456-4989-91b7-55db406ed0ee" path="/var/lib/kubelet/pods/f7ece3e4-7456-4989-91b7-55db406ed0ee/volumes"
Jul 28 19:55:01.403850 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.403816    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe75e274-5d29-4641-9d43-347f26fac385" containerID="8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9" exitCode=0
Jul 28 19:55:01.404294 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.403876    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fpcx5"
Jul 28 19:55:01.404294 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.403907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fpcx5" event={"ID":"fe75e274-5d29-4641-9d43-347f26fac385","Type":"ContainerDied","Data":"8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9"}
Jul 28 19:55:01.404294 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.403952    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fpcx5" event={"ID":"fe75e274-5d29-4641-9d43-347f26fac385","Type":"ContainerDied","Data":"98f6884626886abe46cd3e5faec749702f3d8c5e817ab873db72604f29fe8dbc"}
Jul 28 19:55:01.404294 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.403974    2575 scope.go:117] "RemoveContainer" containerID="8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9"
Jul 28 19:55:01.412623 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.412594    2575 scope.go:117] "RemoveContainer" containerID="8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9"
Jul 28 19:55:01.412900 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:55:01.412880    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9\": container with ID starting with 8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9 not found: ID does not exist" containerID="8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9"
Jul 28 19:55:01.412989 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.412915    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9"} err="failed to get container status \"8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9\": rpc error: code = NotFound desc = could not find container \"8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9\": container with ID starting with 8e07b9445000df0306cae14d78b5951036d19c258592a304a96ecf24f4e187a9 not found: ID does not exist"
Jul 28 19:55:01.421669 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.421638    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpcx5"]
Jul 28 19:55:01.423498 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:01.423475    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpcx5"]
Jul 28 19:55:03.258676 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:03.258640    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe75e274-5d29-4641-9d43-347f26fac385" path="/var/lib/kubelet/pods/fe75e274-5d29-4641-9d43-347f26fac385/volumes"
Jul 28 19:55:05.400443 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400406    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b7bd9d666-ttv77"]
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400743    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ece3e4-7456-4989-91b7-55db406ed0ee" containerName="authorino"
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400754    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ece3e4-7456-4989-91b7-55db406ed0ee" containerName="authorino"
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400767    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1921fc76-5e69-4a17-b00d-34474a09473b" containerName="authorino"
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400772    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1921fc76-5e69-4a17-b00d-34474a09473b" containerName="authorino"
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400784    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe75e274-5d29-4641-9d43-347f26fac385" containerName="authorino"
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400790    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe75e274-5d29-4641-9d43-347f26fac385" containerName="authorino"
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400844    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1921fc76-5e69-4a17-b00d-34474a09473b" containerName="authorino"
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400851    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe75e274-5d29-4641-9d43-347f26fac385" containerName="authorino"
Jul 28 19:55:05.400871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.400859    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7ece3e4-7456-4989-91b7-55db406ed0ee" containerName="authorino"
Jul 28 19:55:05.413055 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.413026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:05.413255 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.413130    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b7bd9d666-ttv77"]
Jul 28 19:55:05.415844 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.415820    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 19:55:05.415982 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.415825    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kbtxl\""
Jul 28 19:55:05.416045 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.415880    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 19:55:05.516240 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.516157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert\") pod \"maas-controller-6b7bd9d666-ttv77\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") " pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:05.516447 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.516279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6rtn\" (UniqueName: \"kubernetes.io/projected/0c28dd8a-0054-47e9-99be-096027f66c54-kube-api-access-p6rtn\") pod \"maas-controller-6b7bd9d666-ttv77\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") " pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:05.617563 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.617526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rtn\" (UniqueName: \"kubernetes.io/projected/0c28dd8a-0054-47e9-99be-096027f66c54-kube-api-access-p6rtn\") pod \"maas-controller-6b7bd9d666-ttv77\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") " pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:05.617729 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.617620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert\") pod \"maas-controller-6b7bd9d666-ttv77\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") " pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:05.617775 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:55:05.617727    2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 28 19:55:05.617807 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:55:05.617785    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert podName:0c28dd8a-0054-47e9-99be-096027f66c54 nodeName:}" failed. No retries permitted until 2026-07-28 19:55:06.117766591 +0000 UTC m=+497.486903678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert") pod "maas-controller-6b7bd9d666-ttv77" (UID: "0c28dd8a-0054-47e9-99be-096027f66c54") : secret "maas-controller-webhook-cert" not found
Jul 28 19:55:05.626281 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:05.626243    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6rtn\" (UniqueName: \"kubernetes.io/projected/0c28dd8a-0054-47e9-99be-096027f66c54-kube-api-access-p6rtn\") pod \"maas-controller-6b7bd9d666-ttv77\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") " pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:06.122738 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:06.122701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert\") pod \"maas-controller-6b7bd9d666-ttv77\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") " pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:06.125247 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:06.125215    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert\") pod \"maas-controller-6b7bd9d666-ttv77\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") " pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:06.336242 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:06.336198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:06.478910 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:06.478884    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b7bd9d666-ttv77"]
Jul 28 19:55:06.481057 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:55:06.481027    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c28dd8a_0054_47e9_99be_096027f66c54.slice/crio-06280026db9fc7987acf4949bea1b6e879e1a94bd08654cb6b5ab2b9251d3423 WatchSource:0}: Error finding container 06280026db9fc7987acf4949bea1b6e879e1a94bd08654cb6b5ab2b9251d3423: Status 404 returned error can't find the container with id 06280026db9fc7987acf4949bea1b6e879e1a94bd08654cb6b5ab2b9251d3423
Jul 28 19:55:07.445307 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:07.445265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7bd9d666-ttv77" event={"ID":"0c28dd8a-0054-47e9-99be-096027f66c54","Type":"ContainerStarted","Data":"06280026db9fc7987acf4949bea1b6e879e1a94bd08654cb6b5ab2b9251d3423"}
Jul 28 19:55:09.456514 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:09.456477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7bd9d666-ttv77" event={"ID":"0c28dd8a-0054-47e9-99be-096027f66c54","Type":"ContainerStarted","Data":"c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310"}
Jul 28 19:55:09.456943 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:09.456558    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:09.474546 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:09.474479    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b7bd9d666-ttv77" podStartSLOduration=2.344649392 podStartE2EDuration="4.47445882s" totalImagesPullingTime="2.129809428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:55:09.472608203 +0000 UTC m=+500.841745319" watchObservedRunningTime="2026-07-28 19:55:09.47445882 +0000 UTC m=+500.843595930"
Jul 28 19:55:19.628749 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:19.628709    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b7bd9d666-ttv77"]
Jul 28 19:55:19.629145 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:19.628904    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b7bd9d666-ttv77" podUID="0c28dd8a-0054-47e9-99be-096027f66c54" containerName="manager" containerID="cri-o://c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310" gracePeriod=30
Jul 28 19:55:19.630820 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:19.630797    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:19.875662 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:19.875638    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:19.950026 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:19.949940    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6rtn\" (UniqueName: \"kubernetes.io/projected/0c28dd8a-0054-47e9-99be-096027f66c54-kube-api-access-p6rtn\") pod \"0c28dd8a-0054-47e9-99be-096027f66c54\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") "
Jul 28 19:55:19.950026 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:19.949993    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert\") pod \"0c28dd8a-0054-47e9-99be-096027f66c54\" (UID: \"0c28dd8a-0054-47e9-99be-096027f66c54\") "
Jul 28 19:55:19.952293 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:19.952261    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0c28dd8a-0054-47e9-99be-096027f66c54" (UID: "0c28dd8a-0054-47e9-99be-096027f66c54"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:55:19.952406 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:19.952314    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c28dd8a-0054-47e9-99be-096027f66c54-kube-api-access-p6rtn" (OuterVolumeSpecName: "kube-api-access-p6rtn") pod "0c28dd8a-0054-47e9-99be-096027f66c54" (UID: "0c28dd8a-0054-47e9-99be-096027f66c54"). InnerVolumeSpecName "kube-api-access-p6rtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:55:20.051280 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.051237    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6rtn\" (UniqueName: \"kubernetes.io/projected/0c28dd8a-0054-47e9-99be-096027f66c54-kube-api-access-p6rtn\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:55:20.051280 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.051271    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c28dd8a-0054-47e9-99be-096027f66c54-webhook-cert\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:55:20.512904 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.512859    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c28dd8a-0054-47e9-99be-096027f66c54" containerID="c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310" exitCode=0
Jul 28 19:55:20.513118 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.512917    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b7bd9d666-ttv77"
Jul 28 19:55:20.513118 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.512940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7bd9d666-ttv77" event={"ID":"0c28dd8a-0054-47e9-99be-096027f66c54","Type":"ContainerDied","Data":"c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310"}
Jul 28 19:55:20.513118 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.513023    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b7bd9d666-ttv77" event={"ID":"0c28dd8a-0054-47e9-99be-096027f66c54","Type":"ContainerDied","Data":"06280026db9fc7987acf4949bea1b6e879e1a94bd08654cb6b5ab2b9251d3423"}
Jul 28 19:55:20.513118 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.513046    2575 scope.go:117] "RemoveContainer" containerID="c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310"
Jul 28 19:55:20.522445 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.522419    2575 scope.go:117] "RemoveContainer" containerID="c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310"
Jul 28 19:55:20.522749 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:55:20.522726    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310\": container with ID starting with c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310 not found: ID does not exist" containerID="c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310"
Jul 28 19:55:20.522801 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.522759    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310"} err="failed to get container status \"c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310\": rpc error: code = NotFound desc = could not find container \"c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310\": container with ID starting with c52bc3b00009036204ac7ba9af3a382b391e110bd22286b8e5c5156450451310 not found: ID does not exist"
Jul 28 19:55:20.533785 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.533754    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b7bd9d666-ttv77"]
Jul 28 19:55:20.539694 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:20.539665    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b7bd9d666-ttv77"]
Jul 28 19:55:21.257903 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:21.257866    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c28dd8a-0054-47e9-99be-096027f66c54" path="/var/lib/kubelet/pods/0c28dd8a-0054-47e9-99be-096027f66c54/volumes"
Jul 28 19:55:38.646040 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.646003    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"]
Jul 28 19:55:38.646567 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.646366    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c28dd8a-0054-47e9-99be-096027f66c54" containerName="manager"
Jul 28 19:55:38.646567 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.646378    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c28dd8a-0054-47e9-99be-096027f66c54" containerName="manager"
Jul 28 19:55:38.646567 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.646431    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c28dd8a-0054-47e9-99be-096027f66c54" containerName="manager"
Jul 28 19:55:38.650943 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.650916    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.653495 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.653467    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 28 19:55:38.653667 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.653515    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5t8gx\""
Jul 28 19:55:38.662897 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.662865    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"]
Jul 28 19:55:38.712692 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.712660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b316111e-eab4-40a1-af2c-6961f38a7d06-maas-api-tls\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.712865 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.712715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpqbd\" (UniqueName: \"kubernetes.io/projected/b316111e-eab4-40a1-af2c-6961f38a7d06-kube-api-access-bpqbd\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.712865 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.712817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b316111e-eab4-40a1-af2c-6961f38a7d06-openshift-service-ca\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.813454 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.813410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b316111e-eab4-40a1-af2c-6961f38a7d06-maas-api-tls\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.813648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.813480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpqbd\" (UniqueName: \"kubernetes.io/projected/b316111e-eab4-40a1-af2c-6961f38a7d06-kube-api-access-bpqbd\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.813648 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.813543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b316111e-eab4-40a1-af2c-6961f38a7d06-openshift-service-ca\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.814274 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.814248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b316111e-eab4-40a1-af2c-6961f38a7d06-openshift-service-ca\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.816084 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.816056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b316111e-eab4-40a1-af2c-6961f38a7d06-maas-api-tls\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.824898 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.824866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpqbd\" (UniqueName: \"kubernetes.io/projected/b316111e-eab4-40a1-af2c-6961f38a7d06-kube-api-access-bpqbd\") pod \"maas-api-5f588fc9bf-6dh6l\" (UID: \"b316111e-eab4-40a1-af2c-6961f38a7d06\") " pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:38.962665 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:38.962566    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:39.113679 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.113652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"]
Jul 28 19:55:39.116150 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:55:39.116121    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb316111e_eab4_40a1_af2c_6961f38a7d06.slice/crio-2ed5fb0ffb83977ed92d1f8234449301d0f3b47127fad48aa6c45118ae7a92f2 WatchSource:0}: Error finding container 2ed5fb0ffb83977ed92d1f8234449301d0f3b47127fad48aa6c45118ae7a92f2: Status 404 returned error can't find the container with id 2ed5fb0ffb83977ed92d1f8234449301d0f3b47127fad48aa6c45118ae7a92f2
Jul 28 19:55:39.156840 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.156803    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tnwkf"]
Jul 28 19:55:39.161217 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.161160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:39.164044 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.164010    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 19:55:39.164236 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.164106    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g9l8q\""
Jul 28 19:55:39.171540 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.171507    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tnwkf"]
Jul 28 19:55:39.203353 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.203318    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"]
Jul 28 19:55:39.206792 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.206769    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:39.216692 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.216663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6666fe9f-555c-4149-bad3-d9873b42cc6c-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ltr2d\" (UID: \"6666fe9f-555c-4149-bad3-d9873b42cc6c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:39.216966 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.216939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfaf35c8-de5c-4cb4-ae36-e80829ecc97e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tnwkf\" (UID: \"cfaf35c8-de5c-4cb4-ae36-e80829ecc97e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:39.217083 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.216983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvvm\" (UniqueName: \"kubernetes.io/projected/cfaf35c8-de5c-4cb4-ae36-e80829ecc97e-kube-api-access-ckvvm\") pod \"payload-processing-5cc6cd444b-tnwkf\" (UID: \"cfaf35c8-de5c-4cb4-ae36-e80829ecc97e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:39.217083 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.217011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln8nr\" (UniqueName: \"kubernetes.io/projected/6666fe9f-555c-4149-bad3-d9873b42cc6c-kube-api-access-ln8nr\") pod \"payload-pre-processing-687dbb6cf6-ltr2d\" (UID: \"6666fe9f-555c-4149-bad3-d9873b42cc6c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:39.218061 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.218040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"]
Jul 28 19:55:39.317724 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.317682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6666fe9f-555c-4149-bad3-d9873b42cc6c-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ltr2d\" (UID: \"6666fe9f-555c-4149-bad3-d9873b42cc6c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:39.317931 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.317757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfaf35c8-de5c-4cb4-ae36-e80829ecc97e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tnwkf\" (UID: \"cfaf35c8-de5c-4cb4-ae36-e80829ecc97e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:39.317931 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.317779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvvm\" (UniqueName: \"kubernetes.io/projected/cfaf35c8-de5c-4cb4-ae36-e80829ecc97e-kube-api-access-ckvvm\") pod \"payload-processing-5cc6cd444b-tnwkf\" (UID: \"cfaf35c8-de5c-4cb4-ae36-e80829ecc97e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:39.317931 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.317798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln8nr\" (UniqueName: \"kubernetes.io/projected/6666fe9f-555c-4149-bad3-d9873b42cc6c-kube-api-access-ln8nr\") pod \"payload-pre-processing-687dbb6cf6-ltr2d\" (UID: \"6666fe9f-555c-4149-bad3-d9873b42cc6c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:39.318600 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.318575    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6666fe9f-555c-4149-bad3-d9873b42cc6c-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-ltr2d\" (UID: \"6666fe9f-555c-4149-bad3-d9873b42cc6c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:39.318809 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.318784    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cfaf35c8-de5c-4cb4-ae36-e80829ecc97e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-tnwkf\" (UID: \"cfaf35c8-de5c-4cb4-ae36-e80829ecc97e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:39.326687 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.326659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvvm\" (UniqueName: \"kubernetes.io/projected/cfaf35c8-de5c-4cb4-ae36-e80829ecc97e-kube-api-access-ckvvm\") pod \"payload-processing-5cc6cd444b-tnwkf\" (UID: \"cfaf35c8-de5c-4cb4-ae36-e80829ecc97e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:39.326890 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.326758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln8nr\" (UniqueName: \"kubernetes.io/projected/6666fe9f-555c-4149-bad3-d9873b42cc6c-kube-api-access-ln8nr\") pod \"payload-pre-processing-687dbb6cf6-ltr2d\" (UID: \"6666fe9f-555c-4149-bad3-d9873b42cc6c\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:39.473029 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.472930    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:39.517964 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.517926    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:39.606779 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.606736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l" event={"ID":"b316111e-eab4-40a1-af2c-6961f38a7d06","Type":"ContainerStarted","Data":"2ed5fb0ffb83977ed92d1f8234449301d0f3b47127fad48aa6c45118ae7a92f2"}
Jul 28 19:55:39.634541 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.634246    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-tnwkf"]
Jul 28 19:55:39.636644 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:55:39.636613    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfaf35c8_de5c_4cb4_ae36_e80829ecc97e.slice/crio-34e39ed5403aae2d45d9e11e50fc7ac1248a4ea9790fda4495536d55e259114b WatchSource:0}: Error finding container 34e39ed5403aae2d45d9e11e50fc7ac1248a4ea9790fda4495536d55e259114b: Status 404 returned error can't find the container with id 34e39ed5403aae2d45d9e11e50fc7ac1248a4ea9790fda4495536d55e259114b
Jul 28 19:55:39.681002 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:39.680974    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"]
Jul 28 19:55:39.683496 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:55:39.683460    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6666fe9f_555c_4149_bad3_d9873b42cc6c.slice/crio-e7a459ab0b4dcb06ba2b24166cec08b22c6a8d0c4b89b474aa7a5661fe4ea5ce WatchSource:0}: Error finding container e7a459ab0b4dcb06ba2b24166cec08b22c6a8d0c4b89b474aa7a5661fe4ea5ce: Status 404 returned error can't find the container with id e7a459ab0b4dcb06ba2b24166cec08b22c6a8d0c4b89b474aa7a5661fe4ea5ce
Jul 28 19:55:40.618390 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:40.618348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf" event={"ID":"cfaf35c8-de5c-4cb4-ae36-e80829ecc97e","Type":"ContainerStarted","Data":"34e39ed5403aae2d45d9e11e50fc7ac1248a4ea9790fda4495536d55e259114b"}
Jul 28 19:55:40.624755 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:40.624656    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d" event={"ID":"6666fe9f-555c-4149-bad3-d9873b42cc6c","Type":"ContainerStarted","Data":"e7a459ab0b4dcb06ba2b24166cec08b22c6a8d0c4b89b474aa7a5661fe4ea5ce"}
Jul 28 19:55:42.638918 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.638885    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d" event={"ID":"6666fe9f-555c-4149-bad3-d9873b42cc6c","Type":"ContainerStarted","Data":"263e8f8bd618f87bd5289b4056431118d4987ce2c546d504cb1f3dbaa4d6df85"}
Jul 28 19:55:42.639345 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.639034    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:42.640580 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.640559    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf" event={"ID":"cfaf35c8-de5c-4cb4-ae36-e80829ecc97e","Type":"ContainerStarted","Data":"f0879e9e338040dc9d488fa87898f83da1d967e42c957d4f4cc50a6a76f7d2d9"}
Jul 28 19:55:42.640702 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.640681    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:55:42.642288 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.642265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l" event={"ID":"b316111e-eab4-40a1-af2c-6961f38a7d06","Type":"ContainerStarted","Data":"3aa42030e690030935bbce87436a02f18f4635ec39e6d035dd3bc05d2e04bf7e"}
Jul 28 19:55:42.642404 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.642390    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:42.653750 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.653692    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d" podStartSLOduration=1.371139247 podStartE2EDuration="3.653677567s" totalImagesPullingTime="2.28253832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:55:42.652468583 +0000 UTC m=+534.021605722" watchObservedRunningTime="2026-07-28 19:55:42.653677567 +0000 UTC m=+534.022814656"
Jul 28 19:55:42.668188 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.668125    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf" podStartSLOduration=1.346153475 podStartE2EDuration="3.66810983s" totalImagesPullingTime="2.321956355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:55:42.666742084 +0000 UTC m=+534.035879206" watchObservedRunningTime="2026-07-28 19:55:42.66810983 +0000 UTC m=+534.037246940"
Jul 28 19:55:42.681480 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:42.681416    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l" podStartSLOduration=1.837490053 podStartE2EDuration="4.681393064s" totalImagesPullingTime="2.843903011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:55:42.680651163 +0000 UTC m=+534.049788289" watchObservedRunningTime="2026-07-28 19:55:42.681393064 +0000 UTC m=+534.050530175"
Jul 28 19:55:47.669536 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:47.669500    2575 generic.go:356] "Generic (PLEG): container finished" podID="81cbf011-0d2d-44aa-b31f-5144af101d24" containerID="5e48136b28273115abc0de008b0ce8c2d1a5975e7269ad539e2ff781d8419fcc" exitCode=0
Jul 28 19:55:47.669963 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:47.669574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" event={"ID":"81cbf011-0d2d-44aa-b31f-5144af101d24","Type":"ContainerDied","Data":"5e48136b28273115abc0de008b0ce8c2d1a5975e7269ad539e2ff781d8419fcc"}
Jul 28 19:55:47.669963 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:47.669942    2575 scope.go:117] "RemoveContainer" containerID="5e48136b28273115abc0de008b0ce8c2d1a5975e7269ad539e2ff781d8419fcc"
Jul 28 19:55:47.670913 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:47.670887    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:55:47.671013 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:47.670954    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:55:47.671013 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:47.670986    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 19:55:48.653091 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:48.653061    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5f588fc9bf-6dh6l"
Jul 28 19:55:48.678562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:48.678522    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" event={"ID":"81cbf011-0d2d-44aa-b31f-5144af101d24","Type":"ContainerStarted","Data":"a18f5ee2e909d0e2fea1de61b4484de15198eb9e7bedbb42b2ea12e190e99ff3"}
Jul 28 19:55:49.020328 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:49.020285    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:55:49.021633 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:49.021605    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zvf29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 28 19:55:49.021771 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:49.021657    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" podUID="81cbf011-0d2d-44aa-b31f-5144af101d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 28 19:55:50.020344 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:50.020302    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zvf29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 28 19:55:50.020771 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:50.020364    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" podUID="81cbf011-0d2d-44aa-b31f-5144af101d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 28 19:55:51.020493 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:51.020447    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zvf29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 28 19:55:51.020909 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:51.020510    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" podUID="81cbf011-0d2d-44aa-b31f-5144af101d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 28 19:55:52.021129 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:52.021091    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zvf29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 28 19:55:52.021567 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:52.021161    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29" podUID="81cbf011-0d2d-44aa-b31f-5144af101d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 28 19:55:53.025013 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:53.024985    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:55:53.025475 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:53.025345    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:55:53.026181 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:53.026150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29"
Jul 28 19:55:53.649050 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:53.649018    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d"
Jul 28 19:55:53.649288 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:55:53.649103    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-tnwkf"
Jul 28 19:56:22.881409 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:22.881368    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"]
Jul 28 19:56:22.883959 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:22.883939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:22.886568 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:22.886545    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 19:56:22.887606 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:22.887593    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 19:56:22.887671 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:22.887648    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 19:56:22.887734 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:22.887717    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f8572\""
Jul 28 19:56:22.894577 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:22.894554    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"]
Jul 28 19:56:23.006293 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.006250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e430dc2-b4df-41ca-954d-4a596da76052-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.006472 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.006316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.006472 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.006380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.006472 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.006448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.006577 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.006472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc9nd\" (UniqueName: \"kubernetes.io/projected/8e430dc2-b4df-41ca-954d-4a596da76052-kube-api-access-mc9nd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.006577 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.006495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.107849 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.107799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e430dc2-b4df-41ca-954d-4a596da76052-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.108051 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.107879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.108051 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.107908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.108051 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.107968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.108051 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.107995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc9nd\" (UniqueName: \"kubernetes.io/projected/8e430dc2-b4df-41ca-954d-4a596da76052-kube-api-access-mc9nd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.108051 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.108024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.108479 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.108449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.108656 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.108634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.108764 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.108723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.110476 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.110456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e430dc2-b4df-41ca-954d-4a596da76052-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.110616 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.110598    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e430dc2-b4df-41ca-954d-4a596da76052-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.117146 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.117121    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc9nd\" (UniqueName: \"kubernetes.io/projected/8e430dc2-b4df-41ca-954d-4a596da76052-kube-api-access-mc9nd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nb96p\" (UID: \"8e430dc2-b4df-41ca-954d-4a596da76052\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.195312 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.195206    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:23.333863 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.333837    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"]
Jul 28 19:56:23.336009 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:56:23.335984    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e430dc2_b4df_41ca_954d_4a596da76052.slice/crio-09d9fafd217e59fbeaf71f4403b2df86e281be27b37c526435f05f0f19eb0761 WatchSource:0}: Error finding container 09d9fafd217e59fbeaf71f4403b2df86e281be27b37c526435f05f0f19eb0761: Status 404 returned error can't find the container with id 09d9fafd217e59fbeaf71f4403b2df86e281be27b37c526435f05f0f19eb0761
Jul 28 19:56:23.850325 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:23.850214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p" event={"ID":"8e430dc2-b4df-41ca-954d-4a596da76052","Type":"ContainerStarted","Data":"09d9fafd217e59fbeaf71f4403b2df86e281be27b37c526435f05f0f19eb0761"}
Jul 28 19:56:24.856760 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:24.856720    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p" event={"ID":"8e430dc2-b4df-41ca-954d-4a596da76052","Type":"ContainerStarted","Data":"5d26dba4fb41ced75293b2e75fbcaf71561fa1babf475c4a3ab382326d6e8b90"}
Jul 28 19:56:24.874476 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:24.874424    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p" podStartSLOduration=1.846223686 podStartE2EDuration="2.874406744s" totalImagesPullingTime="1.028183058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:56:24.873188932 +0000 UTC m=+576.242326033" watchObservedRunningTime="2026-07-28 19:56:24.874406744 +0000 UTC m=+576.243543854"
Jul 28 19:56:33.195727 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:33.195682    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:33.196336 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:33.195744    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:33.208729 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:33.208702    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:33.912737 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:33.912702    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nb96p"
Jul 28 19:56:38.160314 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.160275    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"]
Jul 28 19:56:38.163872 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.163851    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.166236 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.166216    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 28 19:56:38.174082 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.174049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"]
Jul 28 19:56:38.347908 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.347858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.348121 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.347921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7rg\" (UniqueName: \"kubernetes.io/projected/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-kube-api-access-bq7rg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.348121 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.348029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.348121 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.348059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.348353 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.348200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.348353 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.348298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449141 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449046    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449141 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7rg\" (UniqueName: \"kubernetes.io/projected/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-kube-api-access-bq7rg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449141 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449441 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449441 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449441 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449558    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449593 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.449690 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.449630    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.451800 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.451771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.451917 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.451863    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.456995 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.456963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7rg\" (UniqueName: \"kubernetes.io/projected/dec2cb4e-f3b2-43ee-9453-14e2c8dcb611-kube-api-access-bq7rg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g8hlq\" (UID: \"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.476019 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.475978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:38.639517 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.639492    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"]
Jul 28 19:56:38.641486 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:56:38.641458    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec2cb4e_f3b2_43ee_9453_14e2c8dcb611.slice/crio-ece0eb96d3bf3a00ab49414c9b3e64a65868ee873ceea6de4346f35fa82f976d WatchSource:0}: Error finding container ece0eb96d3bf3a00ab49414c9b3e64a65868ee873ceea6de4346f35fa82f976d: Status 404 returned error can't find the container with id ece0eb96d3bf3a00ab49414c9b3e64a65868ee873ceea6de4346f35fa82f976d
Jul 28 19:56:38.927697 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.927653    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq" event={"ID":"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611","Type":"ContainerStarted","Data":"aa49ccd2fa0b73f88ebb65a8eb9dd5924100076cd2f224bd360f871d3be6a403"}
Jul 28 19:56:38.927901 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.927708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq" event={"ID":"dec2cb4e-f3b2-43ee-9453-14e2c8dcb611","Type":"ContainerStarted","Data":"ece0eb96d3bf3a00ab49414c9b3e64a65868ee873ceea6de4346f35fa82f976d"}
Jul 28 19:56:38.944421 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:38.944368    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq" podStartSLOduration=0.771369114 podStartE2EDuration="944.349701ms" totalImagesPullingTime="172.980587ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:56:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:56:38.943637208 +0000 UTC m=+590.312774330" watchObservedRunningTime="2026-07-28 19:56:38.944349701 +0000 UTC m=+590.313486811"
Jul 28 19:56:48.476753 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:48.476714    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:48.477159 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:48.476787    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:48.489524 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:48.489494    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:56:48.990232 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:56:48.990200    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g8hlq"
Jul 28 19:57:11.865456 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.865375    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"]
Jul 28 19:57:11.869905 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.869885    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:11.872314 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.872294    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 28 19:57:11.879974 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.879948    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"]
Jul 28 19:57:11.940748 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.940721    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:11.940893 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.940778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:11.940893 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.940868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvwrb\" (UniqueName: \"kubernetes.io/projected/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-kube-api-access-bvwrb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:11.940979 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.940905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:11.940979 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.940942    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:11.941055 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:11.941000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.041758 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.041724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.041912 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.041794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.041912 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.041823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvwrb\" (UniqueName: \"kubernetes.io/projected/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-kube-api-access-bvwrb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.041912 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.041843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.041912 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.041863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.042128 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.041915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.042298 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.042275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.042383 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.042295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.042383 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.042337    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.044115 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.044089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.044562 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.044539    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.050511 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.050492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvwrb\" (UniqueName: \"kubernetes.io/projected/b35ffc14-2194-46f4-a6fa-dc912de2c9b6-kube-api-access-bvwrb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xvr6j\" (UID: \"b35ffc14-2194-46f4-a6fa-dc912de2c9b6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.181944 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.181851    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:12.316676 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.316649    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"]
Jul 28 19:57:12.318941 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:57:12.318915    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35ffc14_2194_46f4_a6fa_dc912de2c9b6.slice/crio-3734e11e64f14e85b54bdbe84951141a3a03b274397756edee414d5e32b7edea WatchSource:0}: Error finding container 3734e11e64f14e85b54bdbe84951141a3a03b274397756edee414d5e32b7edea: Status 404 returned error can't find the container with id 3734e11e64f14e85b54bdbe84951141a3a03b274397756edee414d5e32b7edea
Jul 28 19:57:12.320628 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:12.320612    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:57:13.090143 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:13.090100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j" event={"ID":"b35ffc14-2194-46f4-a6fa-dc912de2c9b6","Type":"ContainerStarted","Data":"8c161caf30aa44eaba54246acffa16951d914941310672b801e9fd992fab1efc"}
Jul 28 19:57:13.090543 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:13.090231    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j" event={"ID":"b35ffc14-2194-46f4-a6fa-dc912de2c9b6","Type":"ContainerStarted","Data":"3734e11e64f14e85b54bdbe84951141a3a03b274397756edee414d5e32b7edea"}
Jul 28 19:57:13.109257 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:13.109200    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j" podStartSLOduration=1.900502283 podStartE2EDuration="2.109183854s" totalImagesPullingTime="208.681571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:57:13.107480611 +0000 UTC m=+624.476617727" watchObservedRunningTime="2026-07-28 19:57:13.109183854 +0000 UTC m=+624.478320957"
Jul 28 19:57:20.973305 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:20.973264    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"]
Jul 28 19:57:20.976757 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:20.976733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:20.979114 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:20.979089    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 28 19:57:20.984415 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:20.984375    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"]
Jul 28 19:57:21.129551 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.129518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.129551 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.129567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f58bdd5-e584-4134-9823-2c31a1c090d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.129810 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.129588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.129810 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.129629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.129810 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.129659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.129810 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.129733    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9tr\" (UniqueName: \"kubernetes.io/projected/0f58bdd5-e584-4134-9823-2c31a1c090d0-kube-api-access-ss9tr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.230784 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.230747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.230954 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.230806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f58bdd5-e584-4134-9823-2c31a1c090d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.230954 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.230874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.231066 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.231016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.231119 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.231090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.231209 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.231132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9tr\" (UniqueName: \"kubernetes.io/projected/0f58bdd5-e584-4134-9823-2c31a1c090d0-kube-api-access-ss9tr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.231323 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.231298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.231382 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.231319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.231530 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.231507    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.233388 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.233368    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f58bdd5-e584-4134-9823-2c31a1c090d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.233630 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.233613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f58bdd5-e584-4134-9823-2c31a1c090d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.239100 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.239072    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9tr\" (UniqueName: \"kubernetes.io/projected/0f58bdd5-e584-4134-9823-2c31a1c090d0-kube-api-access-ss9tr\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9\" (UID: \"0f58bdd5-e584-4134-9823-2c31a1c090d0\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.287667 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.287618    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:21.428493 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:21.428467    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"]
Jul 28 19:57:21.430651 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:57:21.430616    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f58bdd5_e584_4134_9823_2c31a1c090d0.slice/crio-4a1a5c39f5148a9c352d73d33c092cfc612573733bd134d605e71c0438c1aab8 WatchSource:0}: Error finding container 4a1a5c39f5148a9c352d73d33c092cfc612573733bd134d605e71c0438c1aab8: Status 404 returned error can't find the container with id 4a1a5c39f5148a9c352d73d33c092cfc612573733bd134d605e71c0438c1aab8
Jul 28 19:57:22.136743 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:22.136702    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9" event={"ID":"0f58bdd5-e584-4134-9823-2c31a1c090d0","Type":"ContainerStarted","Data":"f9f3c424f209980908aef8e49e162f6b046c59cb7beafe3dd569c1bc27723527"}
Jul 28 19:57:22.137185 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:22.136757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9" event={"ID":"0f58bdd5-e584-4134-9823-2c31a1c090d0","Type":"ContainerStarted","Data":"4a1a5c39f5148a9c352d73d33c092cfc612573733bd134d605e71c0438c1aab8"}
Jul 28 19:57:22.153103 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:22.153040    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9" podStartSLOduration=1.978096602 podStartE2EDuration="2.153023505s" totalImagesPullingTime="174.926903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:57:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:57:22.152672214 +0000 UTC m=+633.521809324" watchObservedRunningTime="2026-07-28 19:57:22.153023505 +0000 UTC m=+633.522160680"
Jul 28 19:57:22.183073 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:22.183029    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:22.183305 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:22.183122    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:22.196207 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:22.196161    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:23.152644 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:23.152617    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xvr6j"
Jul 28 19:57:31.288122 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:31.288080    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:31.288122 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:31.288130    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:31.300751 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:31.300710    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:57:32.198046 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:57:32.198013    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9"
Jul 28 19:58:13.548381 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.548345    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-769b854499-6rh2j"]
Jul 28 19:58:13.551655 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.551630    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769b854499-6rh2j"
Jul 28 19:58:13.557893 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.557862    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-769b854499-6rh2j"]
Jul 28 19:58:13.607854 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.607813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5mj5\" (UniqueName: \"kubernetes.io/projected/a4974522-5e2b-471c-9930-6780bc6d1b42-kube-api-access-b5mj5\") pod \"authorino-769b854499-6rh2j\" (UID: \"a4974522-5e2b-471c-9930-6780bc6d1b42\") " pod="kuadrant-system/authorino-769b854499-6rh2j"
Jul 28 19:58:13.608043 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.607904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4974522-5e2b-471c-9930-6780bc6d1b42-tls-cert\") pod \"authorino-769b854499-6rh2j\" (UID: \"a4974522-5e2b-471c-9930-6780bc6d1b42\") " pod="kuadrant-system/authorino-769b854499-6rh2j"
Jul 28 19:58:13.708877 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.708841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5mj5\" (UniqueName: \"kubernetes.io/projected/a4974522-5e2b-471c-9930-6780bc6d1b42-kube-api-access-b5mj5\") pod \"authorino-769b854499-6rh2j\" (UID: \"a4974522-5e2b-471c-9930-6780bc6d1b42\") " pod="kuadrant-system/authorino-769b854499-6rh2j"
Jul 28 19:58:13.709068 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.708916    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4974522-5e2b-471c-9930-6780bc6d1b42-tls-cert\") pod \"authorino-769b854499-6rh2j\" (UID: \"a4974522-5e2b-471c-9930-6780bc6d1b42\") " pod="kuadrant-system/authorino-769b854499-6rh2j"
Jul 28 19:58:13.711576 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.711542    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4974522-5e2b-471c-9930-6780bc6d1b42-tls-cert\") pod \"authorino-769b854499-6rh2j\" (UID: \"a4974522-5e2b-471c-9930-6780bc6d1b42\") " pod="kuadrant-system/authorino-769b854499-6rh2j"
Jul 28 19:58:13.716212 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.716184    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5mj5\" (UniqueName: \"kubernetes.io/projected/a4974522-5e2b-471c-9930-6780bc6d1b42-kube-api-access-b5mj5\") pod \"authorino-769b854499-6rh2j\" (UID: \"a4974522-5e2b-471c-9930-6780bc6d1b42\") " pod="kuadrant-system/authorino-769b854499-6rh2j"
Jul 28 19:58:13.862122 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:13.862036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769b854499-6rh2j"
Jul 28 19:58:14.001028 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:14.000988    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-769b854499-6rh2j"]
Jul 28 19:58:14.003567 ip-10-0-128-236 kubenswrapper[2575]: W0728 19:58:14.003532    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4974522_5e2b_471c_9930_6780bc6d1b42.slice/crio-45f6ded76e0288018f93fa2a1415f6afad0a9158fdb8a36c813a0a28c8df9c27 WatchSource:0}: Error finding container 45f6ded76e0288018f93fa2a1415f6afad0a9158fdb8a36c813a0a28c8df9c27: Status 404 returned error can't find the container with id 45f6ded76e0288018f93fa2a1415f6afad0a9158fdb8a36c813a0a28c8df9c27
Jul 28 19:58:14.383305 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:14.383265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769b854499-6rh2j" event={"ID":"a4974522-5e2b-471c-9930-6780bc6d1b42","Type":"ContainerStarted","Data":"45f6ded76e0288018f93fa2a1415f6afad0a9158fdb8a36c813a0a28c8df9c27"}
Jul 28 19:58:15.390140 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.390098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769b854499-6rh2j" event={"ID":"a4974522-5e2b-471c-9930-6780bc6d1b42","Type":"ContainerStarted","Data":"98b9dfb025a5caf68f8b4db9cf1a54424d588523e4abee9e8e250a26b9e2df93"}
Jul 28 19:58:15.405711 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.405650    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-769b854499-6rh2j" podStartSLOduration=1.926349036 podStartE2EDuration="2.405631398s" totalImagesPullingTime="479.282362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:58:15.404453604 +0000 UTC m=+686.773590717" watchObservedRunningTime="2026-07-28 19:58:15.405631398 +0000 UTC m=+686.774768508"
Jul 28 19:58:15.436253 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.436217    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b69854658-dr2t2"]
Jul 28 19:58:15.436682 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.436631    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6b69854658-dr2t2" podUID="db031038-ee19-45b6-a741-82e982cb5fba" containerName="authorino" containerID="cri-o://3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6" gracePeriod=30
Jul 28 19:58:15.709296 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.709272    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:58:15.735771 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.735727    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k5wk\" (UniqueName: \"kubernetes.io/projected/db031038-ee19-45b6-a741-82e982cb5fba-kube-api-access-2k5wk\") pod \"db031038-ee19-45b6-a741-82e982cb5fba\" (UID: \"db031038-ee19-45b6-a741-82e982cb5fba\") "
Jul 28 19:58:15.735963 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.735788    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db031038-ee19-45b6-a741-82e982cb5fba-tls-cert\") pod \"db031038-ee19-45b6-a741-82e982cb5fba\" (UID: \"db031038-ee19-45b6-a741-82e982cb5fba\") "
Jul 28 19:58:15.738186 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.738133    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db031038-ee19-45b6-a741-82e982cb5fba-kube-api-access-2k5wk" (OuterVolumeSpecName: "kube-api-access-2k5wk") pod "db031038-ee19-45b6-a741-82e982cb5fba" (UID: "db031038-ee19-45b6-a741-82e982cb5fba"). InnerVolumeSpecName "kube-api-access-2k5wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:58:15.747826 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.747791    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db031038-ee19-45b6-a741-82e982cb5fba-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "db031038-ee19-45b6-a741-82e982cb5fba" (UID: "db031038-ee19-45b6-a741-82e982cb5fba"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:58:15.837361 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.837329    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k5wk\" (UniqueName: \"kubernetes.io/projected/db031038-ee19-45b6-a741-82e982cb5fba-kube-api-access-2k5wk\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:58:15.837361 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:15.837364    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db031038-ee19-45b6-a741-82e982cb5fba-tls-cert\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 19:58:16.397057 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.397019    2575 generic.go:356] "Generic (PLEG): container finished" podID="db031038-ee19-45b6-a741-82e982cb5fba" containerID="3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6" exitCode=0
Jul 28 19:58:16.397572 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.397069    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b69854658-dr2t2"
Jul 28 19:58:16.397572 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.397104    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b69854658-dr2t2" event={"ID":"db031038-ee19-45b6-a741-82e982cb5fba","Type":"ContainerDied","Data":"3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6"}
Jul 28 19:58:16.397572 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.397149    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b69854658-dr2t2" event={"ID":"db031038-ee19-45b6-a741-82e982cb5fba","Type":"ContainerDied","Data":"2a92eb423e1812ac87b3ab8da714485aeaaf9683cdfa3b819e4e29b38a36e91e"}
Jul 28 19:58:16.397572 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.397183    2575 scope.go:117] "RemoveContainer" containerID="3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6"
Jul 28 19:58:16.409321 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.409296    2575 scope.go:117] "RemoveContainer" containerID="3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6"
Jul 28 19:58:16.409773 ip-10-0-128-236 kubenswrapper[2575]: E0728 19:58:16.409750    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6\": container with ID starting with 3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6 not found: ID does not exist" containerID="3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6"
Jul 28 19:58:16.409871 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.409783    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6"} err="failed to get container status \"3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6\": rpc error: code = NotFound desc = could not find container \"3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6\": container with ID starting with 3566af26abb90bce49f849ab1dda8ef3141d1d45b9f01940a0442be1952db7b6 not found: ID does not exist"
Jul 28 19:58:16.420141 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.420109    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b69854658-dr2t2"]
Jul 28 19:58:16.430019 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:16.429986    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b69854658-dr2t2"]
Jul 28 19:58:17.258473 ip-10-0-128-236 kubenswrapper[2575]: I0728 19:58:17.258440    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db031038-ee19-45b6-a741-82e982cb5fba" path="/var/lib/kubelet/pods/db031038-ee19-45b6-a741-82e982cb5fba/volumes"
Jul 28 20:13:46.165149 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.165047    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"]
Jul 28 20:13:46.167849 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.165726    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db031038-ee19-45b6-a741-82e982cb5fba" containerName="authorino"
Jul 28 20:13:46.167849 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.165745    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db031038-ee19-45b6-a741-82e982cb5fba" containerName="authorino"
Jul 28 20:13:46.167849 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.165839    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db031038-ee19-45b6-a741-82e982cb5fba" containerName="authorino"
Jul 28 20:13:46.169342 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.169315    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.172090 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.172065    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0603e8fc-serving-cert\""
Jul 28 20:13:46.176486 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.176455    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"]
Jul 28 20:13:46.307175 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.307129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.307376 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.307287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5cc\" (UniqueName: \"kubernetes.io/projected/36edb4b5-697f-47f4-b75e-a1cce03354ee-kube-api-access-vq5cc\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.307376 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.307340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36edb4b5-697f-47f4-b75e-a1cce03354ee-openshift-service-ca\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.408497 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.408440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5cc\" (UniqueName: \"kubernetes.io/projected/36edb4b5-697f-47f4-b75e-a1cce03354ee-kube-api-access-vq5cc\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.408715 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.408510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36edb4b5-697f-47f4-b75e-a1cce03354ee-openshift-service-ca\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.408715 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.408591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.408841 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:13:46.408733    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-serving-cert: secret "maas-api-e2e-ait-0603e8fc-serving-cert" not found
Jul 28 20:13:46.408841 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:13:46.408806    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls podName:36edb4b5-697f-47f4-b75e-a1cce03354ee nodeName:}" failed. No retries permitted until 2026-07-28 20:13:46.908783094 +0000 UTC m=+1618.277920201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls") pod "maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg" (UID: "36edb4b5-697f-47f4-b75e-a1cce03354ee") : secret "maas-api-e2e-ait-0603e8fc-serving-cert" not found
Jul 28 20:13:46.409408 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.409384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36edb4b5-697f-47f4-b75e-a1cce03354ee-openshift-service-ca\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.428578 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.428503    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5cc\" (UniqueName: \"kubernetes.io/projected/36edb4b5-697f-47f4-b75e-a1cce03354ee-kube-api-access-vq5cc\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.914426 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.914388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:46.916991 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:46.916968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls\") pod \"maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:47.037228 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.037193    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"]
Jul 28 20:13:47.040989 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.040968    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:47.045108 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.045078    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0603e8fc-dockercfg-2w8r9\""
Jul 28 20:13:47.045108 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.045100    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0603e8fc\""
Jul 28 20:13:47.052969 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.052936    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"]
Jul 28 20:13:47.084368 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.084332    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:47.217288 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.217247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sjpq\" (UniqueName: \"kubernetes.io/projected/e5a4787b-9a35-406c-8da3-d45ea4ded14e-kube-api-access-6sjpq\") pod \"payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt\" (UID: \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\") " pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:47.217681 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.217459    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5a4787b-9a35-406c-8da3-d45ea4ded14e-plugins-config-volume\") pod \"payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt\" (UID: \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\") " pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:47.241109 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.241079    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"]
Jul 28 20:13:47.243151 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:13:47.243123    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36edb4b5_697f_47f4_b75e_a1cce03354ee.slice/crio-80ac7d9f61be9bec943848b7e17d66ae5234a390c7ade5ab37d1a32c6351ecd9 WatchSource:0}: Error finding container 80ac7d9f61be9bec943848b7e17d66ae5234a390c7ade5ab37d1a32c6351ecd9: Status 404 returned error can't find the container with id 80ac7d9f61be9bec943848b7e17d66ae5234a390c7ade5ab37d1a32c6351ecd9
Jul 28 20:13:47.244895 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.244879    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:13:47.318234 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.318154    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sjpq\" (UniqueName: \"kubernetes.io/projected/e5a4787b-9a35-406c-8da3-d45ea4ded14e-kube-api-access-6sjpq\") pod \"payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt\" (UID: \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\") " pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:47.318459 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.318288    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5a4787b-9a35-406c-8da3-d45ea4ded14e-plugins-config-volume\") pod \"payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt\" (UID: \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\") " pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:47.318946 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.318926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5a4787b-9a35-406c-8da3-d45ea4ded14e-plugins-config-volume\") pod \"payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt\" (UID: \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\") " pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:47.327452 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.327425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sjpq\" (UniqueName: \"kubernetes.io/projected/e5a4787b-9a35-406c-8da3-d45ea4ded14e-kube-api-access-6sjpq\") pod \"payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt\" (UID: \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\") " pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:47.353900 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.353859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:47.507733 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:47.507698    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"]
Jul 28 20:13:47.509399 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:13:47.509360    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a4787b_9a35_406c_8da3_d45ea4ded14e.slice/crio-1656b9fda3a2e2e0f2068f6e67987692eb652aedca80ef28c54e0b805e5b9355 WatchSource:0}: Error finding container 1656b9fda3a2e2e0f2068f6e67987692eb652aedca80ef28c54e0b805e5b9355: Status 404 returned error can't find the container with id 1656b9fda3a2e2e0f2068f6e67987692eb652aedca80ef28c54e0b805e5b9355
Jul 28 20:13:48.077970 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:48.077860    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg" event={"ID":"36edb4b5-697f-47f4-b75e-a1cce03354ee","Type":"ContainerStarted","Data":"64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56"}
Jul 28 20:13:48.077970 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:48.077920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg" event={"ID":"36edb4b5-697f-47f4-b75e-a1cce03354ee","Type":"ContainerStarted","Data":"80ac7d9f61be9bec943848b7e17d66ae5234a390c7ade5ab37d1a32c6351ecd9"}
Jul 28 20:13:48.077970 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:48.077961    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:48.079500 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:48.079470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt" event={"ID":"e5a4787b-9a35-406c-8da3-d45ea4ded14e","Type":"ContainerStarted","Data":"c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd"}
Jul 28 20:13:48.079618 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:48.079524    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt" event={"ID":"e5a4787b-9a35-406c-8da3-d45ea4ded14e","Type":"ContainerStarted","Data":"1656b9fda3a2e2e0f2068f6e67987692eb652aedca80ef28c54e0b805e5b9355"}
Jul 28 20:13:48.079618 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:48.079595    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:13:48.096619 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:48.096566    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg" podStartSLOduration=1.541897783 podStartE2EDuration="2.096549754s" totalImagesPullingTime="554.651971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:13:48.094813368 +0000 UTC m=+1619.463950480" watchObservedRunningTime="2026-07-28 20:13:48.096549754 +0000 UTC m=+1619.465687139"
Jul 28 20:13:48.111426 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:48.111362    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt" podStartSLOduration=1.111345941 podStartE2EDuration="1.111345941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:13:48.11086088 +0000 UTC m=+1619.479998007" watchObservedRunningTime="2026-07-28 20:13:48.111345941 +0000 UTC m=+1619.480483052"
Jul 28 20:13:54.090321 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:54.090289    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:13:59.086619 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:13:59.086582    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:14:16.838147 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:16.838108    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"]
Jul 28 20:14:16.838669 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:16.838374    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg" podUID="36edb4b5-697f-47f4-b75e-a1cce03354ee" containerName="maas-api" containerID="cri-o://64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56" gracePeriod=30
Jul 28 20:14:16.903661 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:16.903626    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"]
Jul 28 20:14:16.903875 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:16.903847    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt" podUID="e5a4787b-9a35-406c-8da3-d45ea4ded14e" containerName="payload-processing" containerID="cri-o://c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd" gracePeriod=30
Jul 28 20:14:17.202134 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.202104    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:14:17.206093 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.206065    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:14:17.230996 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.230960    2575 generic.go:356] "Generic (PLEG): container finished" podID="e5a4787b-9a35-406c-8da3-d45ea4ded14e" containerID="c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd" exitCode=0
Jul 28 20:14:17.231248 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.231018    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"
Jul 28 20:14:17.231248 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.231044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt" event={"ID":"e5a4787b-9a35-406c-8da3-d45ea4ded14e","Type":"ContainerDied","Data":"c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd"}
Jul 28 20:14:17.231248 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.231106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt" event={"ID":"e5a4787b-9a35-406c-8da3-d45ea4ded14e","Type":"ContainerDied","Data":"1656b9fda3a2e2e0f2068f6e67987692eb652aedca80ef28c54e0b805e5b9355"}
Jul 28 20:14:17.231248 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.231138    2575 scope.go:117] "RemoveContainer" containerID="c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd"
Jul 28 20:14:17.232504 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.232481    2575 generic.go:356] "Generic (PLEG): container finished" podID="36edb4b5-697f-47f4-b75e-a1cce03354ee" containerID="64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56" exitCode=0
Jul 28 20:14:17.232610 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.232511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg" event={"ID":"36edb4b5-697f-47f4-b75e-a1cce03354ee","Type":"ContainerDied","Data":"64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56"}
Jul 28 20:14:17.232610 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.232538    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"
Jul 28 20:14:17.232610 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.232577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg" event={"ID":"36edb4b5-697f-47f4-b75e-a1cce03354ee","Type":"ContainerDied","Data":"80ac7d9f61be9bec943848b7e17d66ae5234a390c7ade5ab37d1a32c6351ecd9"}
Jul 28 20:14:17.240377 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.240344    2575 scope.go:117] "RemoveContainer" containerID="c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd"
Jul 28 20:14:17.240911 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:14:17.240871    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd\": container with ID starting with c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd not found: ID does not exist" containerID="c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd"
Jul 28 20:14:17.241078 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.240923    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd"} err="failed to get container status \"c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd\": rpc error: code = NotFound desc = could not find container \"c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd\": container with ID starting with c179c8b3c98300cbbbebcb45f42a84830c3d36e413c0337c45226e705f317abd not found: ID does not exist"
Jul 28 20:14:17.241078 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.240950    2575 scope.go:117] "RemoveContainer" containerID="64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56"
Jul 28 20:14:17.251869 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.251844    2575 scope.go:117] "RemoveContainer" containerID="64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56"
Jul 28 20:14:17.252284 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:14:17.252257    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56\": container with ID starting with 64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56 not found: ID does not exist" containerID="64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56"
Jul 28 20:14:17.252387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.252290    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56"} err="failed to get container status \"64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56\": rpc error: code = NotFound desc = could not find container \"64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56\": container with ID starting with 64fcd67a60773016c46655f1659e7379d295dd51efc883ab5afbce5217b48e56 not found: ID does not exist"
Jul 28 20:14:17.291104 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.291068    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq5cc\" (UniqueName: \"kubernetes.io/projected/36edb4b5-697f-47f4-b75e-a1cce03354ee-kube-api-access-vq5cc\") pod \"36edb4b5-697f-47f4-b75e-a1cce03354ee\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") "
Jul 28 20:14:17.291615 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.291119    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls\") pod \"36edb4b5-697f-47f4-b75e-a1cce03354ee\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") "
Jul 28 20:14:17.291615 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.291211    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36edb4b5-697f-47f4-b75e-a1cce03354ee-openshift-service-ca\") pod \"36edb4b5-697f-47f4-b75e-a1cce03354ee\" (UID: \"36edb4b5-697f-47f4-b75e-a1cce03354ee\") "
Jul 28 20:14:17.291615 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.291251    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5a4787b-9a35-406c-8da3-d45ea4ded14e-plugins-config-volume\") pod \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\" (UID: \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\") "
Jul 28 20:14:17.291615 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.291285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sjpq\" (UniqueName: \"kubernetes.io/projected/e5a4787b-9a35-406c-8da3-d45ea4ded14e-kube-api-access-6sjpq\") pod \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\" (UID: \"e5a4787b-9a35-406c-8da3-d45ea4ded14e\") "
Jul 28 20:14:17.292031 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.291951    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36edb4b5-697f-47f4-b75e-a1cce03354ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36edb4b5-697f-47f4-b75e-a1cce03354ee" (UID: "36edb4b5-697f-47f4-b75e-a1cce03354ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:14:17.295823 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.292507    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5a4787b-9a35-406c-8da3-d45ea4ded14e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e5a4787b-9a35-406c-8da3-d45ea4ded14e" (UID: "e5a4787b-9a35-406c-8da3-d45ea4ded14e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:14:17.302942 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.302896    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36edb4b5-697f-47f4-b75e-a1cce03354ee-kube-api-access-vq5cc" (OuterVolumeSpecName: "kube-api-access-vq5cc") pod "36edb4b5-697f-47f4-b75e-a1cce03354ee" (UID: "36edb4b5-697f-47f4-b75e-a1cce03354ee"). InnerVolumeSpecName "kube-api-access-vq5cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:17.303202 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.302939    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36edb4b5-697f-47f4-b75e-a1cce03354ee" (UID: "36edb4b5-697f-47f4-b75e-a1cce03354ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:14:17.304000 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.303966    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5a4787b-9a35-406c-8da3-d45ea4ded14e-kube-api-access-6sjpq" (OuterVolumeSpecName: "kube-api-access-6sjpq") pod "e5a4787b-9a35-406c-8da3-d45ea4ded14e" (UID: "e5a4787b-9a35-406c-8da3-d45ea4ded14e"). InnerVolumeSpecName "kube-api-access-6sjpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:17.394613 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.394512    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36edb4b5-697f-47f4-b75e-a1cce03354ee-openshift-service-ca\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:17.394613 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.394541    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5a4787b-9a35-406c-8da3-d45ea4ded14e-plugins-config-volume\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:17.394613 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.394551    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sjpq\" (UniqueName: \"kubernetes.io/projected/e5a4787b-9a35-406c-8da3-d45ea4ded14e-kube-api-access-6sjpq\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:17.394613 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.394561    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq5cc\" (UniqueName: \"kubernetes.io/projected/36edb4b5-697f-47f4-b75e-a1cce03354ee-kube-api-access-vq5cc\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:17.394613 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.394577    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36edb4b5-697f-47f4-b75e-a1cce03354ee-maas-api-tls\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:17.555740 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.555697    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"]
Jul 28 20:14:17.560847 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.560817    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0603e8fc-76f5d67fcf-ckfgg"]
Jul 28 20:14:17.572143 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.572113    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"]
Jul 28 20:14:17.574012 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:17.573989    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt"]
Jul 28 20:14:18.180629 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.180521    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"]
Jul 28 20:14:18.181149 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.181126    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a4787b-9a35-406c-8da3-d45ea4ded14e" containerName="payload-processing"
Jul 28 20:14:18.181267 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.181152    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a4787b-9a35-406c-8da3-d45ea4ded14e" containerName="payload-processing"
Jul 28 20:14:18.181267 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.181200    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36edb4b5-697f-47f4-b75e-a1cce03354ee" containerName="maas-api"
Jul 28 20:14:18.181267 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.181209    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="36edb4b5-697f-47f4-b75e-a1cce03354ee" containerName="maas-api"
Jul 28 20:14:18.181423 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.181296    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5a4787b-9a35-406c-8da3-d45ea4ded14e" containerName="payload-processing"
Jul 28 20:14:18.181423 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.181317    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="36edb4b5-697f-47f4-b75e-a1cce03354ee" containerName="maas-api"
Jul 28 20:14:18.186072 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.186047    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.188766 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.188740    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-916f7ae5-gw-openshift-default-dockercfg-mk8zz\""
Jul 28 20:14:18.198886 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.198833    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"]
Jul 28 20:14:18.304430 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-socket\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.304648 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lrfn\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-kube-api-access-2lrfn\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.304648 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-envoy\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.304648 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3937a4f-d690-478d-8c3c-939032447526-istiod-ca-cert\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.304899 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304652    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-data\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.304899 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-certs\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.304899 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-credential-socket\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.304899 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3937a4f-d690-478d-8c3c-939032447526-istio-podinfo\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.304899 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.304874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-istio-token\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.405981 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.405939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-socket\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406181 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.405993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lrfn\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-kube-api-access-2lrfn\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406181 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-envoy\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406181 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3937a4f-d690-478d-8c3c-939032447526-istiod-ca-cert\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406181 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-data\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406443 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-socket\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406667 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406646    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-data\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406794 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-certs\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406892 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406872    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3937a4f-d690-478d-8c3c-939032447526-istiod-ca-cert\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.406955 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-credential-socket\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.407013 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.406956    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3937a4f-d690-478d-8c3c-939032447526-istio-podinfo\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.407013 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.407002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-istio-token\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.407346 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.407316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-certs\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.407346 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.407341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-credential-socket\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.408944 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.408921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-envoy\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.410083 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.410061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3937a4f-d690-478d-8c3c-939032447526-istio-podinfo\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.418572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.418526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-istio-token\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.418736 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.418594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lrfn\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-kube-api-access-2lrfn\") pod \"e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") " pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.497718 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.497665    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:18.653912 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.653875    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"]
Jul 28 20:14:18.654704 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:14:18.654677    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3937a4f_d690_478d_8c3c_939032447526.slice/crio-14ba7dad0fb96e8077d71e2f774f4929735d14ff3fe91648f36e51f5bb10c5d8 WatchSource:0}: Error finding container 14ba7dad0fb96e8077d71e2f774f4929735d14ff3fe91648f36e51f5bb10c5d8: Status 404 returned error can't find the container with id 14ba7dad0fb96e8077d71e2f774f4929735d14ff3fe91648f36e51f5bb10c5d8
Jul 28 20:14:18.656952 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.656922    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:14:18.657023 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.657004    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:14:18.657063 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:18.657039    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:14:19.246626 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:19.246582    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" event={"ID":"c3937a4f-d690-478d-8c3c-939032447526","Type":"ContainerStarted","Data":"6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813"}
Jul 28 20:14:19.247028 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:19.246656    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" event={"ID":"c3937a4f-d690-478d-8c3c-939032447526","Type":"ContainerStarted","Data":"14ba7dad0fb96e8077d71e2f774f4929735d14ff3fe91648f36e51f5bb10c5d8"}
Jul 28 20:14:19.259251 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:19.259224    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36edb4b5-697f-47f4-b75e-a1cce03354ee" path="/var/lib/kubelet/pods/36edb4b5-697f-47f4-b75e-a1cce03354ee/volumes"
Jul 28 20:14:19.259577 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:19.259564    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5a4787b-9a35-406c-8da3-d45ea4ded14e" path="/var/lib/kubelet/pods/e5a4787b-9a35-406c-8da3-d45ea4ded14e/volumes"
Jul 28 20:14:19.268122 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:19.268079    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podStartSLOduration=1.26806521 podStartE2EDuration="1.26806521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:19.267454933 +0000 UTC m=+1650.636592044" watchObservedRunningTime="2026-07-28 20:14:19.26806521 +0000 UTC m=+1650.637202320"
Jul 28 20:14:19.498425 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:19.498333    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:19.499913 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:19.499887    2575 patch_prober.go:28] interesting pod/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:14:19.500042 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:19.499953    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 20:14:20.503509 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:20.503470    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:21.258261 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:21.258229    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:21.258434 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:21.258300    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:36.259220 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:36.259180    2575 patch_prober.go:28] interesting pod/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:14:36.259694 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:36.259257    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 20:14:36.349941 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:36.349903    2575 generic.go:356] "Generic (PLEG): container finished" podID="c3937a4f-d690-478d-8c3c-939032447526" containerID="6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813" exitCode=0
Jul 28 20:14:36.350126 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:36.349977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" event={"ID":"c3937a4f-d690-478d-8c3c-939032447526","Type":"ContainerDied","Data":"6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813"}
Jul 28 20:14:36.350480 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:36.350460    2575 scope.go:117] "RemoveContainer" containerID="6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813"
Jul 28 20:14:36.351564 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:36.351538    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:14:36.351621 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:36.351609    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:14:36.351657 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:36.351641    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:14:37.356830 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:37.356796    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" event={"ID":"c3937a4f-d690-478d-8c3c-939032447526","Type":"ContainerStarted","Data":"19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b"}
Jul 28 20:14:37.498897 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:37.498846    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:37.499289 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:37.498970    2575 patch_prober.go:28] interesting pod/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:14:37.499551 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:37.499519    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 20:14:38.498127 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:38.498075    2575 patch_prober.go:28] interesting pod/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:14:38.498684 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:38.498150    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 20:14:39.498939 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:39.498893    2575 patch_prober.go:28] interesting pod/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:14:39.499612 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:39.499573    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 20:14:40.499089 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:40.499046    2575 patch_prober.go:28] interesting pod/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 20:14:40.499767 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:40.499729    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 20:14:41.503084 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:41.503052    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:41.503596 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:41.503478    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:41.504297 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:41.504275    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:51.796871 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:51.796818    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"]
Jul 28 20:14:51.797403 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:51.797131    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy" containerID="cri-o://19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b" gracePeriod=30
Jul 28 20:14:56.505869 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:56.505828    2575 patch_prober.go:28] interesting pod/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:14:56.506369 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:56.505900    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:14:57.063656 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.063584    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:57.193330 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193288    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-credential-socket\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193559 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193375    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-certs\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193559 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193406    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-istio-token\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193559 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193439    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-envoy\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193559 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193490    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3937a4f-d690-478d-8c3c-939032447526-istio-podinfo\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193559 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193553    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-socket\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193864 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193578    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lrfn\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-kube-api-access-2lrfn\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193864 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193615    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3937a4f-d690-478d-8c3c-939032447526-istiod-ca-cert\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193864 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193656    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-data\") pod \"c3937a4f-d690-478d-8c3c-939032447526\" (UID: \"c3937a4f-d690-478d-8c3c-939032447526\") "
Jul 28 20:14:57.193864 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.193822    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:57.194873 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.194072    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-certs\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.194873 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.194194    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:57.194873 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.194511    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3937a4f-d690-478d-8c3c-939032447526-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:14:57.194873 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.194686    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:57.195478 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.195438    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:57.196380 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.196352    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:57.196493 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.196442    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:57.196670 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.196640    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3937a4f-d690-478d-8c3c-939032447526-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:14:57.196769 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.196726    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-kube-api-access-2lrfn" (OuterVolumeSpecName: "kube-api-access-2lrfn") pod "c3937a4f-d690-478d-8c3c-939032447526" (UID: "c3937a4f-d690-478d-8c3c-939032447526"). InnerVolumeSpecName "kube-api-access-2lrfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:57.295477 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.295443    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-istio-token\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.295477 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.295474    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-envoy\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.295477 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.295485    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3937a4f-d690-478d-8c3c-939032447526-istio-podinfo\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.295730 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.295498    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-workload-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.295730 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.295512    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lrfn\" (UniqueName: \"kubernetes.io/projected/c3937a4f-d690-478d-8c3c-939032447526-kube-api-access-2lrfn\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.295730 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.295521    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3937a4f-d690-478d-8c3c-939032447526-istiod-ca-cert\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.295730 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.295528    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-istio-data\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.295730 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.295536    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3937a4f-d690-478d-8c3c-939032447526-credential-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:14:57.475441 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.475343    2575 generic.go:356] "Generic (PLEG): container finished" podID="c3937a4f-d690-478d-8c3c-939032447526" containerID="19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b" exitCode=0
Jul 28 20:14:57.475441 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.475397    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"
Jul 28 20:14:57.475441 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.475412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" event={"ID":"c3937a4f-d690-478d-8c3c-939032447526","Type":"ContainerDied","Data":"19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b"}
Jul 28 20:14:57.475671 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.475458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj" event={"ID":"c3937a4f-d690-478d-8c3c-939032447526","Type":"ContainerDied","Data":"14ba7dad0fb96e8077d71e2f774f4929735d14ff3fe91648f36e51f5bb10c5d8"}
Jul 28 20:14:57.475671 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.475492    2575 scope.go:117] "RemoveContainer" containerID="19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b"
Jul 28 20:14:57.486595 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.486561    2575 scope.go:117] "RemoveContainer" containerID="6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813"
Jul 28 20:14:57.493097 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.493069    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"]
Jul 28 20:14:57.496847 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.496813    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj"]
Jul 28 20:14:57.497255 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.497234    2575 scope.go:117] "RemoveContainer" containerID="19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b"
Jul 28 20:14:57.497587 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:14:57.497565    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b\": container with ID starting with 19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b not found: ID does not exist" containerID="19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b"
Jul 28 20:14:57.497643 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.497599    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b"} err="failed to get container status \"19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b\": rpc error: code = NotFound desc = could not find container \"19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b\": container with ID starting with 19d3e03fa8f5443b8701abe501b38b9de26298e6f38fa68f29d7de8e6f10ea0b not found: ID does not exist"
Jul 28 20:14:57.497643 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.497619    2575 scope.go:117] "RemoveContainer" containerID="6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813"
Jul 28 20:14:57.497935 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:14:57.497917    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813\": container with ID starting with 6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813 not found: ID does not exist" containerID="6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813"
Jul 28 20:14:57.497991 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:57.497942    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813"} err="failed to get container status \"6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813\": rpc error: code = NotFound desc = could not find container \"6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813\": container with ID starting with 6dc50d2242b00c3531a3632141c3f2fb3148a5b8c090949c0264669709678813 not found: ID does not exist"
Jul 28 20:14:59.258651 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:14:59.258607    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3937a4f-d690-478d-8c3c-939032447526" path="/var/lib/kubelet/pods/c3937a4f-d690-478d-8c3c-939032447526/volumes"
Jul 28 20:15:31.617052 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.616958    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"]
Jul 28 20:15:31.617572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.617405    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy"
Jul 28 20:15:31.617572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.617418    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy"
Jul 28 20:15:31.617572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.617444    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy"
Jul 28 20:15:31.617572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.617451    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy"
Jul 28 20:15:31.617572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.617523    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy"
Jul 28 20:15:31.620239 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.620217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:31.624219 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.624193    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-10cc1978\""
Jul 28 20:15:31.625797 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.625773    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-10cc1978-dockercfg-55s4n\""
Jul 28 20:15:31.642293 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.642258    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"]
Jul 28 20:15:31.709406 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.709359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e35821-9db9-419f-9855-0f21d8e29359-plugins-config-volume\") pod \"payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk\" (UID: \"b4e35821-9db9-419f-9855-0f21d8e29359\") " pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:31.709627 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.709558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjmf\" (UniqueName: \"kubernetes.io/projected/b4e35821-9db9-419f-9855-0f21d8e29359-kube-api-access-4cjmf\") pod \"payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk\" (UID: \"b4e35821-9db9-419f-9855-0f21d8e29359\") " pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:31.810869 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.810822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e35821-9db9-419f-9855-0f21d8e29359-plugins-config-volume\") pod \"payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk\" (UID: \"b4e35821-9db9-419f-9855-0f21d8e29359\") " pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:31.811065 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.810921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjmf\" (UniqueName: \"kubernetes.io/projected/b4e35821-9db9-419f-9855-0f21d8e29359-kube-api-access-4cjmf\") pod \"payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk\" (UID: \"b4e35821-9db9-419f-9855-0f21d8e29359\") " pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:31.811609 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.811587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e35821-9db9-419f-9855-0f21d8e29359-plugins-config-volume\") pod \"payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk\" (UID: \"b4e35821-9db9-419f-9855-0f21d8e29359\") " pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:31.821299 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.821269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjmf\" (UniqueName: \"kubernetes.io/projected/b4e35821-9db9-419f-9855-0f21d8e29359-kube-api-access-4cjmf\") pod \"payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk\" (UID: \"b4e35821-9db9-419f-9855-0f21d8e29359\") " pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:31.931435 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:31.931334    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:32.078299 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:32.078270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"]
Jul 28 20:15:32.080427 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:15:32.080391    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e35821_9db9_419f_9855_0f21d8e29359.slice/crio-da04242d59f972860038c94c2b24152506f2c9aec7282bd3ad38b1b88bbd7a70 WatchSource:0}: Error finding container da04242d59f972860038c94c2b24152506f2c9aec7282bd3ad38b1b88bbd7a70: Status 404 returned error can't find the container with id da04242d59f972860038c94c2b24152506f2c9aec7282bd3ad38b1b88bbd7a70
Jul 28 20:15:32.658345 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:32.658289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk" event={"ID":"b4e35821-9db9-419f-9855-0f21d8e29359","Type":"ContainerStarted","Data":"bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98"}
Jul 28 20:15:32.658861 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:32.658370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk" event={"ID":"b4e35821-9db9-419f-9855-0f21d8e29359","Type":"ContainerStarted","Data":"da04242d59f972860038c94c2b24152506f2c9aec7282bd3ad38b1b88bbd7a70"}
Jul 28 20:15:32.658861 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:32.658474    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:15:32.674589 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:32.674527    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk" podStartSLOduration=1.674504077 podStartE2EDuration="1.674504077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:15:32.672775146 +0000 UTC m=+1724.041912258" watchObservedRunningTime="2026-07-28 20:15:32.674504077 +0000 UTC m=+1724.043641210"
Jul 28 20:15:43.666014 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:15:43.665984    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:16:01.435210 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.435158    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"]
Jul 28 20:16:01.435802 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.435397    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk" podUID="b4e35821-9db9-419f-9855-0f21d8e29359" containerName="payload-processing" containerID="cri-o://bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98" gracePeriod=30
Jul 28 20:16:01.705724 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.705682    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:16:01.798454 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.798419    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e35821-9db9-419f-9855-0f21d8e29359-plugins-config-volume\") pod \"b4e35821-9db9-419f-9855-0f21d8e29359\" (UID: \"b4e35821-9db9-419f-9855-0f21d8e29359\") "
Jul 28 20:16:01.798617 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.798478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cjmf\" (UniqueName: \"kubernetes.io/projected/b4e35821-9db9-419f-9855-0f21d8e29359-kube-api-access-4cjmf\") pod \"b4e35821-9db9-419f-9855-0f21d8e29359\" (UID: \"b4e35821-9db9-419f-9855-0f21d8e29359\") "
Jul 28 20:16:01.798894 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.798862    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4e35821-9db9-419f-9855-0f21d8e29359-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b4e35821-9db9-419f-9855-0f21d8e29359" (UID: "b4e35821-9db9-419f-9855-0f21d8e29359"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:16:01.800808 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.800779    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e35821-9db9-419f-9855-0f21d8e29359-kube-api-access-4cjmf" (OuterVolumeSpecName: "kube-api-access-4cjmf") pod "b4e35821-9db9-419f-9855-0f21d8e29359" (UID: "b4e35821-9db9-419f-9855-0f21d8e29359"). InnerVolumeSpecName "kube-api-access-4cjmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:16:01.804825 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.804796    2575 generic.go:356] "Generic (PLEG): container finished" podID="b4e35821-9db9-419f-9855-0f21d8e29359" containerID="bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98" exitCode=0
Jul 28 20:16:01.804956 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.804837    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"
Jul 28 20:16:01.804956 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.804884    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk" event={"ID":"b4e35821-9db9-419f-9855-0f21d8e29359","Type":"ContainerDied","Data":"bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98"}
Jul 28 20:16:01.804956 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.804935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk" event={"ID":"b4e35821-9db9-419f-9855-0f21d8e29359","Type":"ContainerDied","Data":"da04242d59f972860038c94c2b24152506f2c9aec7282bd3ad38b1b88bbd7a70"}
Jul 28 20:16:01.805077 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.804964    2575 scope.go:117] "RemoveContainer" containerID="bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98"
Jul 28 20:16:01.819141 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.819110    2575 scope.go:117] "RemoveContainer" containerID="bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98"
Jul 28 20:16:01.819992 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:16:01.819966    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98\": container with ID starting with bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98 not found: ID does not exist" containerID="bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98"
Jul 28 20:16:01.820087 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.820006    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98"} err="failed to get container status \"bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98\": rpc error: code = NotFound desc = could not find container \"bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98\": container with ID starting with bad19de3e7653fb18e9180716bc9190fcddcf0eb15c14f16eeaeb135cb3b2b98 not found: ID does not exist"
Jul 28 20:16:01.832027 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.831987    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"]
Jul 28 20:16:01.834810 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.834780    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk"]
Jul 28 20:16:01.899727 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.899696    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4e35821-9db9-419f-9855-0f21d8e29359-plugins-config-volume\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:16:01.899727 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:01.899723    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cjmf\" (UniqueName: \"kubernetes.io/projected/b4e35821-9db9-419f-9855-0f21d8e29359-kube-api-access-4cjmf\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:16:03.258285 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:16:03.258248    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e35821-9db9-419f-9855-0f21d8e29359" path="/var/lib/kubelet/pods/b4e35821-9db9-419f-9855-0f21d8e29359/volumes"
Jul 28 20:22:59.072808 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.072720    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"]
Jul 28 20:22:59.073283 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.073102    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e35821-9db9-419f-9855-0f21d8e29359" containerName="payload-processing"
Jul 28 20:22:59.073283 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.073114    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e35821-9db9-419f-9855-0f21d8e29359" containerName="payload-processing"
Jul 28 20:22:59.073283 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.073209    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4e35821-9db9-419f-9855-0f21d8e29359" containerName="payload-processing"
Jul 28 20:22:59.073283 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.073220    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3937a4f-d690-478d-8c3c-939032447526" containerName="istio-proxy"
Jul 28 20:22:59.075546 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.075523    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.079932 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.079913    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-117350-serving-cert\""
Jul 28 20:22:59.109361 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.109338    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"]
Jul 28 20:22:59.181181 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.181132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vmjp\" (UniqueName: \"kubernetes.io/projected/627a27b2-2f86-4648-a38e-5d25e6615385-kube-api-access-7vmjp\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.181370 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.181201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.181370 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.181332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/627a27b2-2f86-4648-a38e-5d25e6615385-openshift-service-ca\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.282063 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.282032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/627a27b2-2f86-4648-a38e-5d25e6615385-openshift-service-ca\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.282242 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.282096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vmjp\" (UniqueName: \"kubernetes.io/projected/627a27b2-2f86-4648-a38e-5d25e6615385-kube-api-access-7vmjp\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.282242 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.282116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.282242 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:22:59.282234    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-serving-cert: secret "maas-api-e2e-inf-b-117350-serving-cert" not found
Jul 28 20:22:59.282411 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:22:59.282292    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls podName:627a27b2-2f86-4648-a38e-5d25e6615385 nodeName:}" failed. No retries permitted until 2026-07-28 20:22:59.782276889 +0000 UTC m=+2171.151413976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls") pod "maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f" (UID: "627a27b2-2f86-4648-a38e-5d25e6615385") : secret "maas-api-e2e-inf-b-117350-serving-cert" not found
Jul 28 20:22:59.282728 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.282708    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/627a27b2-2f86-4648-a38e-5d25e6615385-openshift-service-ca\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.303688 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.303669    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vmjp\" (UniqueName: \"kubernetes.io/projected/627a27b2-2f86-4648-a38e-5d25e6615385-kube-api-access-7vmjp\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.784969 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.784937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.787509 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.787487    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls\") pod \"maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:22:59.985147 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:22:59.985121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:23:00.224068 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:23:00.224039    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627a27b2_2f86_4648_a38e_5d25e6615385.slice/crio-24198f4f8b73bb9fab87b1e85133c36cf74c321cbe03b08127c8b3ed640539ae WatchSource:0}: Error finding container 24198f4f8b73bb9fab87b1e85133c36cf74c321cbe03b08127c8b3ed640539ae: Status 404 returned error can't find the container with id 24198f4f8b73bb9fab87b1e85133c36cf74c321cbe03b08127c8b3ed640539ae
Jul 28 20:23:00.225602 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:00.225569    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:23:00.235465 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:00.235438    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"]
Jul 28 20:23:00.910673 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:00.910588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f" event={"ID":"627a27b2-2f86-4648-a38e-5d25e6615385","Type":"ContainerStarted","Data":"5c44679317a75424462d2382d05821a5c1836a0abda21b219776be73076802ba"}
Jul 28 20:23:00.910673 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:00.910638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f" event={"ID":"627a27b2-2f86-4648-a38e-5d25e6615385","Type":"ContainerStarted","Data":"24198f4f8b73bb9fab87b1e85133c36cf74c321cbe03b08127c8b3ed640539ae"}
Jul 28 20:23:00.910853 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:00.910708    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:23:00.991287 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:00.991238    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f" podStartSLOduration=1.6278474859999998 podStartE2EDuration="1.991222965s" totalImagesPullingTime="363.375479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:23:00.989670561 +0000 UTC m=+2172.358807673" watchObservedRunningTime="2026-07-28 20:23:00.991222965 +0000 UTC m=+2172.360360074"
Jul 28 20:23:01.068983 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.068951    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"]
Jul 28 20:23:01.071431 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.071415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.075901 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.075881    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-117350\""
Jul 28 20:23:01.078782 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.078754    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-117350-dockercfg-zgs49\""
Jul 28 20:23:01.100335 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.100313    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"]
Jul 28 20:23:01.197251 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.197159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8065f8ae-f632-456f-bb28-9e5430938cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd\" (UID: \"8065f8ae-f632-456f-bb28-9e5430938cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.197251 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.197228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2ws5\" (UniqueName: \"kubernetes.io/projected/8065f8ae-f632-456f-bb28-9e5430938cd3-kube-api-access-l2ws5\") pod \"payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd\" (UID: \"8065f8ae-f632-456f-bb28-9e5430938cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.298273 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.298246    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8065f8ae-f632-456f-bb28-9e5430938cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd\" (UID: \"8065f8ae-f632-456f-bb28-9e5430938cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.298681 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.298300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2ws5\" (UniqueName: \"kubernetes.io/projected/8065f8ae-f632-456f-bb28-9e5430938cd3-kube-api-access-l2ws5\") pod \"payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd\" (UID: \"8065f8ae-f632-456f-bb28-9e5430938cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.299027 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.299002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8065f8ae-f632-456f-bb28-9e5430938cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd\" (UID: \"8065f8ae-f632-456f-bb28-9e5430938cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.347913 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.347885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2ws5\" (UniqueName: \"kubernetes.io/projected/8065f8ae-f632-456f-bb28-9e5430938cd3-kube-api-access-l2ws5\") pod \"payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd\" (UID: \"8065f8ae-f632-456f-bb28-9e5430938cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.381882 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.381858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.531440 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.531420    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"]
Jul 28 20:23:01.532975 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:23:01.532946    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8065f8ae_f632_456f_bb28_9e5430938cd3.slice/crio-322902da5d0ad47a0843773292c32b4f8e20b1301e84303f033bdd613c6c997d WatchSource:0}: Error finding container 322902da5d0ad47a0843773292c32b4f8e20b1301e84303f033bdd613c6c997d: Status 404 returned error can't find the container with id 322902da5d0ad47a0843773292c32b4f8e20b1301e84303f033bdd613c6c997d
Jul 28 20:23:01.916837 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.916803    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd" event={"ID":"8065f8ae-f632-456f-bb28-9e5430938cd3","Type":"ContainerStarted","Data":"a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170"}
Jul 28 20:23:01.917000 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.916863    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd" event={"ID":"8065f8ae-f632-456f-bb28-9e5430938cd3","Type":"ContainerStarted","Data":"322902da5d0ad47a0843773292c32b4f8e20b1301e84303f033bdd613c6c997d"}
Jul 28 20:23:01.917000 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.916891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:23:01.943180 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:01.943126    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd" podStartSLOduration=0.943112441 podStartE2EDuration="943.112441ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:23:01.941821425 +0000 UTC m=+2173.310958535" watchObservedRunningTime="2026-07-28 20:23:01.943112441 +0000 UTC m=+2173.312249550"
Jul 28 20:23:06.922525 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:06.922495    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:23:12.924006 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:23:12.923974    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:25:38.460692 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.460647    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"]
Jul 28 20:25:38.463159 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.460921    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f" podUID="627a27b2-2f86-4648-a38e-5d25e6615385" containerName="maas-api" containerID="cri-o://5c44679317a75424462d2382d05821a5c1836a0abda21b219776be73076802ba" gracePeriod=30
Jul 28 20:25:38.637278 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.637236    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"]
Jul 28 20:25:38.637557 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.637528    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd" podUID="8065f8ae-f632-456f-bb28-9e5430938cd3" containerName="payload-pre-processing" containerID="cri-o://a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170" gracePeriod=30
Jul 28 20:25:38.729775 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.729736    2575 generic.go:356] "Generic (PLEG): container finished" podID="627a27b2-2f86-4648-a38e-5d25e6615385" containerID="5c44679317a75424462d2382d05821a5c1836a0abda21b219776be73076802ba" exitCode=0
Jul 28 20:25:38.729956 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.729804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f" event={"ID":"627a27b2-2f86-4648-a38e-5d25e6615385","Type":"ContainerDied","Data":"5c44679317a75424462d2382d05821a5c1836a0abda21b219776be73076802ba"}
Jul 28 20:25:38.766393 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.766362    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:25:38.903985 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.903946    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/627a27b2-2f86-4648-a38e-5d25e6615385-openshift-service-ca\") pod \"627a27b2-2f86-4648-a38e-5d25e6615385\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") "
Jul 28 20:25:38.904350 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.904223    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls\") pod \"627a27b2-2f86-4648-a38e-5d25e6615385\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") "
Jul 28 20:25:38.904350 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.904300    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vmjp\" (UniqueName: \"kubernetes.io/projected/627a27b2-2f86-4648-a38e-5d25e6615385-kube-api-access-7vmjp\") pod \"627a27b2-2f86-4648-a38e-5d25e6615385\" (UID: \"627a27b2-2f86-4648-a38e-5d25e6615385\") "
Jul 28 20:25:38.904500 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.904385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/627a27b2-2f86-4648-a38e-5d25e6615385-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "627a27b2-2f86-4648-a38e-5d25e6615385" (UID: "627a27b2-2f86-4648-a38e-5d25e6615385"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:25:38.904632 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.904614    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/627a27b2-2f86-4648-a38e-5d25e6615385-openshift-service-ca\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:25:38.906772 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.906747    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "627a27b2-2f86-4648-a38e-5d25e6615385" (UID: "627a27b2-2f86-4648-a38e-5d25e6615385"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:25:38.906902 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.906879    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627a27b2-2f86-4648-a38e-5d25e6615385-kube-api-access-7vmjp" (OuterVolumeSpecName: "kube-api-access-7vmjp") pod "627a27b2-2f86-4648-a38e-5d25e6615385" (UID: "627a27b2-2f86-4648-a38e-5d25e6615385"). InnerVolumeSpecName "kube-api-access-7vmjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:25:38.913854 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:38.913825    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:25:39.005971 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.005925    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8065f8ae-f632-456f-bb28-9e5430938cd3-plugins-config-volume\") pod \"8065f8ae-f632-456f-bb28-9e5430938cd3\" (UID: \"8065f8ae-f632-456f-bb28-9e5430938cd3\") "
Jul 28 20:25:39.006161 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.005996    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2ws5\" (UniqueName: \"kubernetes.io/projected/8065f8ae-f632-456f-bb28-9e5430938cd3-kube-api-access-l2ws5\") pod \"8065f8ae-f632-456f-bb28-9e5430938cd3\" (UID: \"8065f8ae-f632-456f-bb28-9e5430938cd3\") "
Jul 28 20:25:39.006261 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.006209    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a27b2-2f86-4648-a38e-5d25e6615385-maas-api-tls\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:25:39.006261 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.006224    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vmjp\" (UniqueName: \"kubernetes.io/projected/627a27b2-2f86-4648-a38e-5d25e6615385-kube-api-access-7vmjp\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:25:39.006459 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.006429    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8065f8ae-f632-456f-bb28-9e5430938cd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8065f8ae-f632-456f-bb28-9e5430938cd3" (UID: "8065f8ae-f632-456f-bb28-9e5430938cd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:25:39.008380 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.008351    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8065f8ae-f632-456f-bb28-9e5430938cd3-kube-api-access-l2ws5" (OuterVolumeSpecName: "kube-api-access-l2ws5") pod "8065f8ae-f632-456f-bb28-9e5430938cd3" (UID: "8065f8ae-f632-456f-bb28-9e5430938cd3"). InnerVolumeSpecName "kube-api-access-l2ws5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:25:39.107135 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.107097    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8065f8ae-f632-456f-bb28-9e5430938cd3-plugins-config-volume\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:25:39.107135 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.107128    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2ws5\" (UniqueName: \"kubernetes.io/projected/8065f8ae-f632-456f-bb28-9e5430938cd3-kube-api-access-l2ws5\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:25:39.736691 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.736647    2575 generic.go:356] "Generic (PLEG): container finished" podID="8065f8ae-f632-456f-bb28-9e5430938cd3" containerID="a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170" exitCode=0
Jul 28 20:25:39.737161 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.736690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd" event={"ID":"8065f8ae-f632-456f-bb28-9e5430938cd3","Type":"ContainerDied","Data":"a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170"}
Jul 28 20:25:39.737161 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.736720    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"
Jul 28 20:25:39.737161 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.736757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd" event={"ID":"8065f8ae-f632-456f-bb28-9e5430938cd3","Type":"ContainerDied","Data":"322902da5d0ad47a0843773292c32b4f8e20b1301e84303f033bdd613c6c997d"}
Jul 28 20:25:39.737161 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.736789    2575 scope.go:117] "RemoveContainer" containerID="a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170"
Jul 28 20:25:39.738396 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.738370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f" event={"ID":"627a27b2-2f86-4648-a38e-5d25e6615385","Type":"ContainerDied","Data":"24198f4f8b73bb9fab87b1e85133c36cf74c321cbe03b08127c8b3ed640539ae"}
Jul 28 20:25:39.738538 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.738440    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"
Jul 28 20:25:39.748226 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.748156    2575 scope.go:117] "RemoveContainer" containerID="a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170"
Jul 28 20:25:39.748452 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:25:39.748428    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170\": container with ID starting with a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170 not found: ID does not exist" containerID="a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170"
Jul 28 20:25:39.748515 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.748467    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170"} err="failed to get container status \"a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170\": rpc error: code = NotFound desc = could not find container \"a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170\": container with ID starting with a7a65b2829aa744bb6275fd9f815c578d3c844842c7af2e8fb24fd3da6470170 not found: ID does not exist"
Jul 28 20:25:39.748515 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.748494    2575 scope.go:117] "RemoveContainer" containerID="5c44679317a75424462d2382d05821a5c1836a0abda21b219776be73076802ba"
Jul 28 20:25:39.766592 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.766554    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"]
Jul 28 20:25:39.772244 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.772211    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-117350-86b5d74c4f-46c5f"]
Jul 28 20:25:39.789222 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.789182    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"]
Jul 28 20:25:39.793759 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:39.793722    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd"]
Jul 28 20:25:41.259384 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:41.259347    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="627a27b2-2f86-4648-a38e-5d25e6615385" path="/var/lib/kubelet/pods/627a27b2-2f86-4648-a38e-5d25e6615385/volumes"
Jul 28 20:25:41.259787 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:25:41.259738    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8065f8ae-f632-456f-bb28-9e5430938cd3" path="/var/lib/kubelet/pods/8065f8ae-f632-456f-bb28-9e5430938cd3/volumes"
Jul 28 20:26:17.469593 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.469553    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"]
Jul 28 20:26:17.470121 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.469953    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627a27b2-2f86-4648-a38e-5d25e6615385" containerName="maas-api"
Jul 28 20:26:17.470121 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.469965    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="627a27b2-2f86-4648-a38e-5d25e6615385" containerName="maas-api"
Jul 28 20:26:17.470121 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.469983    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8065f8ae-f632-456f-bb28-9e5430938cd3" containerName="payload-pre-processing"
Jul 28 20:26:17.470121 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.469990    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8065f8ae-f632-456f-bb28-9e5430938cd3" containerName="payload-pre-processing"
Jul 28 20:26:17.470121 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.470057    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8065f8ae-f632-456f-bb28-9e5430938cd3" containerName="payload-pre-processing"
Jul 28 20:26:17.470121 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.470067    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="627a27b2-2f86-4648-a38e-5d25e6615385" containerName="maas-api"
Jul 28 20:26:17.474497 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.474473    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.477384 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.477347    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f632f1-openshift-default-dockercfg-czg96\""
Jul 28 20:26:17.487314 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.487284    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"]
Jul 28 20:26:17.573119 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-credential-socket\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.573358 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-envoy\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.573358 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istiod-ca-cert\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.573358 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-socket\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.573358 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-certs\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.573505 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-data\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.573505 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573410    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-podinfo\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.573505 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjjn\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-kube-api-access-5hjjn\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.573505 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.573483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-token\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674182 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjjn\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-kube-api-access-5hjjn\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-token\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-credential-socket\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-envoy\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istiod-ca-cert\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-socket\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-certs\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674716 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-data\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674716 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674437    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-podinfo\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674900 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-socket\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.674991 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.674957    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-certs\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.675241 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.675218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-data\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.675325 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.675277    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istiod-ca-cert\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.675589 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.675559    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-credential-socket\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.677226 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.677196    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-envoy\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.677418 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.677397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-podinfo\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.682877 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.682849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-token\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.682996 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.682969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjjn\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-kube-api-access-5hjjn\") pod \"e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") " pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.786771 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.786727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:17.937303 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.937273    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"]
Jul 28 20:26:17.944456 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.944416    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:26:17.944582 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.944490    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:26:17.944582 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:17.944520    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:26:18.952267 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:18.952214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" event={"ID":"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa","Type":"ContainerStarted","Data":"aba947e09b508a007e6856d56fcac87948cb61fe299a1bd6ff95a5d971dbe121"}
Jul 28 20:26:18.952680 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:18.952285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" event={"ID":"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa","Type":"ContainerStarted","Data":"34fe4eee06d334bce44846b89f920cfe23e00565ce6f8d952ea4c2c593e8df49"}
Jul 28 20:26:18.975954 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:18.975899    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" podStartSLOduration=1.975880352 podStartE2EDuration="1.975880352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:18.974667375 +0000 UTC m=+2370.343804495" watchObservedRunningTime="2026-07-28 20:26:18.975880352 +0000 UTC m=+2370.345017461"
Jul 28 20:26:19.787371 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:19.787328    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:19.792861 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:19.792835    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:19.957105 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:19.957072    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:19.958187 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:19.958143    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:34.039506 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:34.039469    2575 generic.go:356] "Generic (PLEG): container finished" podID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerID="aba947e09b508a007e6856d56fcac87948cb61fe299a1bd6ff95a5d971dbe121" exitCode=0
Jul 28 20:26:34.039974 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:34.039542    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" event={"ID":"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa","Type":"ContainerDied","Data":"aba947e09b508a007e6856d56fcac87948cb61fe299a1bd6ff95a5d971dbe121"}
Jul 28 20:26:34.039974 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:34.039958    2575 scope.go:117] "RemoveContainer" containerID="aba947e09b508a007e6856d56fcac87948cb61fe299a1bd6ff95a5d971dbe121"
Jul 28 20:26:34.041105 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:34.041078    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:26:34.041201 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:34.041145    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:26:34.041239 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:34.041199    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:26:34.957561 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:34.957511    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:35.047291 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:35.047254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" event={"ID":"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa","Type":"ContainerStarted","Data":"52a7835691453e3b4e1fe265bb0199c1ac6e5ea73e47b0d5683d6ea6f372fe16"}
Jul 28 20:26:35.789012 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:35.788968    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:35.789415 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:35.789387    2575 patch_prober.go:28] interesting pod/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 28 20:26:35.789616 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:35.789589    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 28 20:26:36.788393 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:36.787865    2575 patch_prober.go:28] interesting pod/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 28 20:26:36.788393 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:36.787945    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 28 20:26:37.788189 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:37.788122    2575 patch_prober.go:28] interesting pod/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 28 20:26:37.788419 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:37.788219    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 28 20:26:38.787557 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:38.787508    2575 patch_prober.go:28] interesting pod/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 28 20:26:38.787799 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:38.787583    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 28 20:26:39.791958 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:39.791922    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:39.792483 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:39.792361    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:26:39.793159 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:26:39.793136    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:27:41.242257 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:41.242137    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"]
Jul 28 20:27:41.242836 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:41.242470    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy" containerID="cri-o://52a7835691453e3b4e1fe265bb0199c1ac6e5ea73e47b0d5683d6ea6f372fe16" gracePeriod=30
Jul 28 20:27:46.414509 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.414471    2575 generic.go:356] "Generic (PLEG): container finished" podID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerID="52a7835691453e3b4e1fe265bb0199c1ac6e5ea73e47b0d5683d6ea6f372fe16" exitCode=0
Jul 28 20:27:46.414930 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.414627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" event={"ID":"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa","Type":"ContainerDied","Data":"52a7835691453e3b4e1fe265bb0199c1ac6e5ea73e47b0d5683d6ea6f372fe16"}
Jul 28 20:27:46.414930 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.414712    2575 scope.go:117] "RemoveContainer" containerID="aba947e09b508a007e6856d56fcac87948cb61fe299a1bd6ff95a5d971dbe121"
Jul 28 20:27:46.509364 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.509284    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:27:46.542384 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542349    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-envoy\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542384 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542388    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-podinfo\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542653 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542410    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hjjn\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-kube-api-access-5hjjn\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542653 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-token\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542653 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-socket\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542653 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542541    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istiod-ca-cert\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542653 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542565    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-certs\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542653 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542626    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-credential-socket\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542983 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542655    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-data\") pod \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\" (UID: \"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa\") "
Jul 28 20:27:46.542983 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542836    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:27:46.543098 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.543012    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:46.543098 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.542925    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:27:46.543098 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.543027    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:27:46.543442 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.543222    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:27:46.543798 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.543771    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:27:46.544866 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.544838    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:27:46.544969 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.544887    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-kube-api-access-5hjjn" (OuterVolumeSpecName: "kube-api-access-5hjjn") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "kube-api-access-5hjjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:27:46.544969 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.544895    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:27:46.544969 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.544933    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" (UID: "fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:27:46.643711 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.643664    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istiod-ca-cert\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:46.643711 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.643699    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-workload-certs\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:46.643711 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.643709    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-credential-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:46.643711 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.643719    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-data\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:46.643990 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.643729    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-envoy\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:46.643990 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.643737    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-podinfo\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:46.643990 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.643744    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hjjn\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-kube-api-access-5hjjn\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:46.643990 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:46.643753    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa-istio-token\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:27:47.421374 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:47.421340    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp" event={"ID":"fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa","Type":"ContainerDied","Data":"34fe4eee06d334bce44846b89f920cfe23e00565ce6f8d952ea4c2c593e8df49"}
Jul 28 20:27:47.421374 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:47.421359    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"
Jul 28 20:27:47.421890 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:47.421411    2575 scope.go:117] "RemoveContainer" containerID="52a7835691453e3b4e1fe265bb0199c1ac6e5ea73e47b0d5683d6ea6f372fe16"
Jul 28 20:27:47.444769 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:47.444733    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"]
Jul 28 20:27:47.450463 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:47.450428    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp"]
Jul 28 20:27:49.258947 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:27:49.258909    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" path="/var/lib/kubelet/pods/fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa/volumes"
Jul 28 20:28:11.070620 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.070584    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"]
Jul 28 20:28:11.071014 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.070992    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy"
Jul 28 20:28:11.071014 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.071005    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy"
Jul 28 20:28:11.071099 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.071087    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy"
Jul 28 20:28:11.075439 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.075416    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.079382 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.079356    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1231ba-openshift-default-dockercfg-zf9fh\""
Jul 28 20:28:11.096025 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.095995    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"]
Jul 28 20:28:11.176385 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szdrm\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-kube-api-access-szdrm\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.176385 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0dfcbb-3fee-4053-a467-ced45195b55a-istiod-ca-cert\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.176677 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-certs\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.176677 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176523    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-data\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.176677 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-token\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.176677 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-podinfo\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.176889 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-envoy\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.176889 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-credential-socket\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.176889 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.176793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-socket\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.278306 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-data\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.278306 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-token\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.278627 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-podinfo\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.278627 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-envoy\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.278627 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-credential-socket\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.278627 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-socket\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.278627 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szdrm\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-kube-api-access-szdrm\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.278881 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-data\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.279122 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.279095    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-credential-socket\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.279228 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.279134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-socket\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.279415 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.278531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0dfcbb-3fee-4053-a467-ced45195b55a-istiod-ca-cert\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.279543 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.279448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0dfcbb-3fee-4053-a467-ced45195b55a-istiod-ca-cert\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.279919 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.279895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-certs\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.280002 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.279492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-certs\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.281369 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.281335    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-envoy\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.281591 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.281566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-podinfo\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.292757 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.292722    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-token\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.293570 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.293513    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szdrm\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-kube-api-access-szdrm\") pod \"e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") " pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.386805 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.386706    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:11.563967 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.563761    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"]
Jul 28 20:28:11.566229 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:28:11.566197    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0dfcbb_3fee_4053_a467_ced45195b55a.slice/crio-282453f71041f6db42561b2f6b79e51cd14dc7a838971cc42cb781dbdf33c239 WatchSource:0}: Error finding container 282453f71041f6db42561b2f6b79e51cd14dc7a838971cc42cb781dbdf33c239: Status 404 returned error can't find the container with id 282453f71041f6db42561b2f6b79e51cd14dc7a838971cc42cb781dbdf33c239
Jul 28 20:28:11.568672 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.568637    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:28:11.568777 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.568709    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:28:11.568777 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:11.568739    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:28:12.562222 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:12.562179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" event={"ID":"5b0dfcbb-3fee-4053-a467-ced45195b55a","Type":"ContainerStarted","Data":"3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5"}
Jul 28 20:28:12.562723 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:12.562251    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" event={"ID":"5b0dfcbb-3fee-4053-a467-ced45195b55a","Type":"ContainerStarted","Data":"282453f71041f6db42561b2f6b79e51cd14dc7a838971cc42cb781dbdf33c239"}
Jul 28 20:28:12.586907 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:12.586859    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" podStartSLOduration=1.586841132 podStartE2EDuration="1.586841132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:28:12.584754175 +0000 UTC m=+2483.953891284" watchObservedRunningTime="2026-07-28 20:28:12.586841132 +0000 UTC m=+2483.955978245"
Jul 28 20:28:13.387589 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:13.387549    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:13.393100 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:13.393070    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:13.567694 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:13.567662    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:13.568878 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:13.568859    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:29.585868 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:29.585299    2575 patch_prober.go:28] interesting pod/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 20:28:29.585868 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:29.585390    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 20:28:29.653673 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:29.653633    2575 generic.go:356] "Generic (PLEG): container finished" podID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerID="3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5" exitCode=0
Jul 28 20:28:29.653872 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:29.653712    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" event={"ID":"5b0dfcbb-3fee-4053-a467-ced45195b55a","Type":"ContainerDied","Data":"3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5"}
Jul 28 20:28:29.654251 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:29.654233    2575 scope.go:117] "RemoveContainer" containerID="3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5"
Jul 28 20:28:29.655390 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:29.655361    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:28:29.655505 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:29.655441    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:28:29.655505 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:29.655475    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:28:30.660940 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:30.660904    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" event={"ID":"5b0dfcbb-3fee-4053-a467-ced45195b55a","Type":"ContainerStarted","Data":"663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a"}
Jul 28 20:28:31.387183 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:31.387118    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:31.387458 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:31.387425    2575 patch_prober.go:28] interesting pod/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 28 20:28:31.387552 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:31.387494    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 28 20:28:32.388822 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:32.388784    2575 patch_prober.go:28] interesting pod/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 28 20:28:32.389431 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:32.389398    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 28 20:28:33.387701 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:33.387653    2575 patch_prober.go:28] interesting pod/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 28 20:28:33.387947 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:33.387748    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 28 20:28:34.388097 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:34.388043    2575 patch_prober.go:28] interesting pod/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 28 20:28:34.388658 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:34.388140    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 28 20:28:35.391963 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:35.391927    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:35.392486 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:35.392278    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:28:35.393113 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:28:35.393095    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:38:32.997808 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:32.997767    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"]
Jul 28 20:38:32.998675 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:32.998394    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy"
Jul 28 20:38:32.998675 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:32.998410    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy"
Jul 28 20:38:32.998675 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:32.998521    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbbccc6d-0842-48c1-b9e1-7e52b87ae3fa" containerName="istio-proxy"
Jul 28 20:38:33.002029 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.002005    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.004937 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.004913    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-92ba10-serving-cert\""
Jul 28 20:38:33.012042 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.012018    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"]
Jul 28 20:38:33.168526 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.168485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.168526 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.168529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.168887 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.168694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvc5t\" (UniqueName: \"kubernetes.io/projected/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-kube-api-access-vvc5t\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.270093 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.269991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.270093 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.270033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.270360 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.270103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvc5t\" (UniqueName: \"kubernetes.io/projected/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-kube-api-access-vvc5t\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.270837 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.270808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.272813 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.272780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.286728 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.286691    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvc5t\" (UniqueName: \"kubernetes.io/projected/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-kube-api-access-vvc5t\") pod \"maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.314905 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.314859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:33.459585 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.459560    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"]
Jul 28 20:38:33.461691 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:38:33.461659    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a46f4c8_ea5a_4e28_a08c_b2bb1bd70a5b.slice/crio-faae5865f8ab4dd753d6a3d91b58355155fd5d543395f0fa87ae46231b15fa53 WatchSource:0}: Error finding container faae5865f8ab4dd753d6a3d91b58355155fd5d543395f0fa87ae46231b15fa53: Status 404 returned error can't find the container with id faae5865f8ab4dd753d6a3d91b58355155fd5d543395f0fa87ae46231b15fa53
Jul 28 20:38:33.463142 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.463121    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:38:33.771389 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.771352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz" event={"ID":"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b","Type":"ContainerStarted","Data":"faae5865f8ab4dd753d6a3d91b58355155fd5d543395f0fa87ae46231b15fa53"}
Jul 28 20:38:33.871779 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.871736    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"]
Jul 28 20:38:33.876555 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.876531    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:33.880616 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.880590    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-92ba10\""
Jul 28 20:38:33.912076 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.912042    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"]
Jul 28 20:38:33.978953 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.978909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8071ee20-cf6a-4627-958c-c3f112d1ca95-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br\" (UID: \"8071ee20-cf6a-4627-958c-c3f112d1ca95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:33.979513 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:33.979485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zzg9\" (UniqueName: \"kubernetes.io/projected/8071ee20-cf6a-4627-958c-c3f112d1ca95-kube-api-access-9zzg9\") pod \"payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br\" (UID: \"8071ee20-cf6a-4627-958c-c3f112d1ca95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:34.080499 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.080381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zzg9\" (UniqueName: \"kubernetes.io/projected/8071ee20-cf6a-4627-958c-c3f112d1ca95-kube-api-access-9zzg9\") pod \"payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br\" (UID: \"8071ee20-cf6a-4627-958c-c3f112d1ca95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:34.080499 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.080442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8071ee20-cf6a-4627-958c-c3f112d1ca95-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br\" (UID: \"8071ee20-cf6a-4627-958c-c3f112d1ca95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:34.081310 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.081268    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8071ee20-cf6a-4627-958c-c3f112d1ca95-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br\" (UID: \"8071ee20-cf6a-4627-958c-c3f112d1ca95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:34.095249 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.095216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zzg9\" (UniqueName: \"kubernetes.io/projected/8071ee20-cf6a-4627-958c-c3f112d1ca95-kube-api-access-9zzg9\") pod \"payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br\" (UID: \"8071ee20-cf6a-4627-958c-c3f112d1ca95\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:34.188041 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.187987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:34.339034 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.338994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"]
Jul 28 20:38:34.340134 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:38:34.340109    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8071ee20_cf6a_4627_958c_c3f112d1ca95.slice/crio-8d2a608f333f605cb309c749c9fdd61675c64c8a3f52d0d0744fac0dfb1ccff3 WatchSource:0}: Error finding container 8d2a608f333f605cb309c749c9fdd61675c64c8a3f52d0d0744fac0dfb1ccff3: Status 404 returned error can't find the container with id 8d2a608f333f605cb309c749c9fdd61675c64c8a3f52d0d0744fac0dfb1ccff3
Jul 28 20:38:34.778384 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.778346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br" event={"ID":"8071ee20-cf6a-4627-958c-c3f112d1ca95","Type":"ContainerStarted","Data":"79d3ffc438aaf8439ff85877b6730a57732ff4e7752e5938a8a3c8060b586fab"}
Jul 28 20:38:34.778548 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.778410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br" event={"ID":"8071ee20-cf6a-4627-958c-c3f112d1ca95","Type":"ContainerStarted","Data":"8d2a608f333f605cb309c749c9fdd61675c64c8a3f52d0d0744fac0dfb1ccff3"}
Jul 28 20:38:34.778548 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.778539    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:34.798492 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:34.798438    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br" podStartSLOduration=1.798419596 podStartE2EDuration="1.798419596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:38:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:38:34.797866752 +0000 UTC m=+3106.167003858" watchObservedRunningTime="2026-07-28 20:38:34.798419596 +0000 UTC m=+3106.167556716"
Jul 28 20:38:35.786288 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:35.786239    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz" event={"ID":"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b","Type":"ContainerStarted","Data":"31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2"}
Jul 28 20:38:35.786722 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:35.786569    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:35.806497 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:35.806425    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz" podStartSLOduration=1.797381318 podStartE2EDuration="3.806401172s" totalImagesPullingTime="2.009019854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:38:35.803730019 +0000 UTC m=+3107.172867152" watchObservedRunningTime="2026-07-28 20:38:35.806401172 +0000 UTC m=+3107.175538283"
Jul 28 20:38:41.797248 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:41.797209    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:38:45.788411 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:45.788377    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:38:59.058052 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.058011    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"]
Jul 28 20:38:59.061610 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.061577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.064302 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.064283    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-37887f-openshift-default-dockercfg-52k5f\""
Jul 28 20:38:59.080323 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.080287    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"]
Jul 28 20:38:59.114255 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-socket\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.114255 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-podinfo\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.114492 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-credential-socket\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.114492 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istiod-ca-cert\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.114492 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-envoy\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.114492 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrgp\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-kube-api-access-bsrgp\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.114634 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-token\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.114634 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-certs\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.114634 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.114613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-data\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215278 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-socket\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215479 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-podinfo\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215479 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-credential-socket\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215479 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215352    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istiod-ca-cert\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215479 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-envoy\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215479 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrgp\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-kube-api-access-bsrgp\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215746 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-token\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215746 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-certs\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215746 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-data\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215919 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215736    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-socket\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.215919 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.215786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-credential-socket\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.216034 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.216004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-data\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.216215 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.216186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-certs\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.216500 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.216476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istiod-ca-cert\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.218010 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.217986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-envoy\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.218131 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.218093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-podinfo\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.229409 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.229381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-token\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.230820 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.230787    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrgp\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-kube-api-access-bsrgp\") pod \"e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") " pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.372635 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.372533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:38:59.537153 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.537114    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"]
Jul 28 20:38:59.537610 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:38:59.537578    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950dfed3_3dc4_4a1f_8433_dba26268b1ba.slice/crio-94149971a0071c8605ed57429486f0e555d4b3c615ff83ff3669141f2e8fc5e8 WatchSource:0}: Error finding container 94149971a0071c8605ed57429486f0e555d4b3c615ff83ff3669141f2e8fc5e8: Status 404 returned error can't find the container with id 94149971a0071c8605ed57429486f0e555d4b3c615ff83ff3669141f2e8fc5e8
Jul 28 20:38:59.539965 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.539930    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:38:59.540040 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.540008    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:38:59.540040 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.540037    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:38:59.916327 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.916284    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" event={"ID":"950dfed3-3dc4-4a1f-8433-dba26268b1ba","Type":"ContainerStarted","Data":"ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d"}
Jul 28 20:38:59.916526 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.916346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" event={"ID":"950dfed3-3dc4-4a1f-8433-dba26268b1ba","Type":"ContainerStarted","Data":"94149971a0071c8605ed57429486f0e555d4b3c615ff83ff3669141f2e8fc5e8"}
Jul 28 20:38:59.948747 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:38:59.948681    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" podStartSLOduration=0.94866265 podStartE2EDuration="948.66265ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:38:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:38:59.946773445 +0000 UTC m=+3131.315910559" watchObservedRunningTime="2026-07-28 20:38:59.94866265 +0000 UTC m=+3131.317799760"
Jul 28 20:39:00.373372 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:00.373327    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:39:00.378995 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:00.378959    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:39:00.921936 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:00.921897    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:39:00.923154 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:00.923128    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:39:21.043933 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:21.043899    2575 generic.go:356] "Generic (PLEG): container finished" podID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerID="ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d" exitCode=0
Jul 28 20:39:21.044438 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:21.043979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" event={"ID":"950dfed3-3dc4-4a1f-8433-dba26268b1ba","Type":"ContainerDied","Data":"ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d"}
Jul 28 20:39:21.044438 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:21.044430    2575 scope.go:117] "RemoveContainer" containerID="ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d"
Jul 28 20:39:21.046469 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:21.046407    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:39:21.046641 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:21.046619    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:39:21.046743 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:21.046722    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 28 20:39:22.051084 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:22.051043    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" event={"ID":"950dfed3-3dc4-4a1f-8433-dba26268b1ba","Type":"ContainerStarted","Data":"88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4"}
Jul 28 20:39:22.372987 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:22.372889    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:39:22.373152 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:22.373104    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:39:22.373239 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:22.373153    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:39:23.373595 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:23.373548    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:39:23.374051 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:23.373630    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:39:24.373272 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:24.373226    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:39:24.373488 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:24.373289    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:39:25.373763 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:25.373722    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:39:25.374210 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:25.373784    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:39:26.373103 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:26.373065    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:39:26.373328 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:26.373123    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:39:27.377066 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:27.377034    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:39:27.377616 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:27.377456    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:39:27.378274 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:27.378257    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:39:34.056237 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:39:34.056199    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tnwkf_cfaf35c8-de5c-4cb4-ae36-e80829ecc97e/payload-processing/0.log"
Jul 28 20:40:26.555694 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:26.555660    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br_8071ee20-cf6a-4627-958c-c3f112d1ca95/payload-processing/0.log"
Jul 28 20:40:26.696451 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:26.696416    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tnwkf_cfaf35c8-de5c-4cb4-ae36-e80829ecc97e/payload-processing/0.log"
Jul 28 20:40:30.923872 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:30.923826    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"]
Jul 28 20:40:30.928282 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:30.928261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:30.931882 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:30.931847    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-579f3e-serving-cert\""
Jul 28 20:40:30.945554 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:30.945518    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"]
Jul 28 20:40:30.966268 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:30.966222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg2t4\" (UniqueName: \"kubernetes.io/projected/236dcb8f-da31-4ee4-bd90-b18b62be18d4-kube-api-access-mg2t4\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:30.966485 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:30.966359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/236dcb8f-da31-4ee4-bd90-b18b62be18d4-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:30.966485 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:30.966421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.067660 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.067615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/236dcb8f-da31-4ee4-bd90-b18b62be18d4-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.067888 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.067670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.067888 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.067737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg2t4\" (UniqueName: \"kubernetes.io/projected/236dcb8f-da31-4ee4-bd90-b18b62be18d4-kube-api-access-mg2t4\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.067888 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:40:31.067849    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-serving-cert: secret "maas-api-e2e-ipp-cleanup-579f3e-serving-cert" not found
Jul 28 20:40:31.068064 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:40:31.067947    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls podName:236dcb8f-da31-4ee4-bd90-b18b62be18d4 nodeName:}" failed. No retries permitted until 2026-07-28 20:40:31.567923741 +0000 UTC m=+3222.937060846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk" (UID: "236dcb8f-da31-4ee4-bd90-b18b62be18d4") : secret "maas-api-e2e-ipp-cleanup-579f3e-serving-cert" not found
Jul 28 20:40:31.068454 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.068434    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/236dcb8f-da31-4ee4-bd90-b18b62be18d4-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.084127 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.084087    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg2t4\" (UniqueName: \"kubernetes.io/projected/236dcb8f-da31-4ee4-bd90-b18b62be18d4-kube-api-access-mg2t4\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.572648 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.572612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.575367 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.575338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.840078 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.839977    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:31.848041 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.847999    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"]
Jul 28 20:40:31.851863 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.851832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:31.858162 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.858115    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-579f3e-dockercfg-4h6tk\""
Jul 28 20:40:31.858358 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.858282    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-579f3e\""
Jul 28 20:40:31.871123 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.871077    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"]
Jul 28 20:40:31.884536 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.884474    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"]
Jul 28 20:40:31.902492 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.902456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:31.914117 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.914026    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"]
Jul 28 20:40:31.978137 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.978086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4w5\" (UniqueName: \"kubernetes.io/projected/74c64bd8-99e4-4338-b864-646c4d732c42-kube-api-access-fs4w5\") pod \"payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6\" (UID: \"74c64bd8-99e4-4338-b864-646c4d732c42\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:31.978623 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.978276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5c58\" (UniqueName: \"kubernetes.io/projected/d82ae805-06b1-41df-ab75-c1f558d2d46c-kube-api-access-v5c58\") pod \"payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9\" (UID: \"d82ae805-06b1-41df-ab75-c1f558d2d46c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:31.978623 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.978314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74c64bd8-99e4-4338-b864-646c4d732c42-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6\" (UID: \"74c64bd8-99e4-4338-b864-646c4d732c42\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:31.978623 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:31.978379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d82ae805-06b1-41df-ab75-c1f558d2d46c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9\" (UID: \"d82ae805-06b1-41df-ab75-c1f558d2d46c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:32.039033 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.039005    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"]
Jul 28 20:40:32.041012 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:40:32.040985    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236dcb8f_da31_4ee4_bd90_b18b62be18d4.slice/crio-39cc219d3e9d168f8e6d9e47c62c0ad9b2921cf0a259714fab1d5d0a76e8db74 WatchSource:0}: Error finding container 39cc219d3e9d168f8e6d9e47c62c0ad9b2921cf0a259714fab1d5d0a76e8db74: Status 404 returned error can't find the container with id 39cc219d3e9d168f8e6d9e47c62c0ad9b2921cf0a259714fab1d5d0a76e8db74
Jul 28 20:40:32.079193 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.079144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5c58\" (UniqueName: \"kubernetes.io/projected/d82ae805-06b1-41df-ab75-c1f558d2d46c-kube-api-access-v5c58\") pod \"payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9\" (UID: \"d82ae805-06b1-41df-ab75-c1f558d2d46c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:32.079193 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.079199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74c64bd8-99e4-4338-b864-646c4d732c42-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6\" (UID: \"74c64bd8-99e4-4338-b864-646c4d732c42\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:32.079485 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.079244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d82ae805-06b1-41df-ab75-c1f558d2d46c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9\" (UID: \"d82ae805-06b1-41df-ab75-c1f558d2d46c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:32.079485 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.079315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4w5\" (UniqueName: \"kubernetes.io/projected/74c64bd8-99e4-4338-b864-646c4d732c42-kube-api-access-fs4w5\") pod \"payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6\" (UID: \"74c64bd8-99e4-4338-b864-646c4d732c42\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:32.079995 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.079972    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d82ae805-06b1-41df-ab75-c1f558d2d46c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9\" (UID: \"d82ae805-06b1-41df-ab75-c1f558d2d46c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:32.080054 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.079994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74c64bd8-99e4-4338-b864-646c4d732c42-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6\" (UID: \"74c64bd8-99e4-4338-b864-646c4d732c42\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:32.090556 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.090467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4w5\" (UniqueName: \"kubernetes.io/projected/74c64bd8-99e4-4338-b864-646c4d732c42-kube-api-access-fs4w5\") pod \"payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6\" (UID: \"74c64bd8-99e4-4338-b864-646c4d732c42\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:32.092923 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.092894    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5c58\" (UniqueName: \"kubernetes.io/projected/d82ae805-06b1-41df-ab75-c1f558d2d46c-kube-api-access-v5c58\") pod \"payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9\" (UID: \"d82ae805-06b1-41df-ab75-c1f558d2d46c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:32.193887 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.193852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:32.230345 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.230302    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:32.374219 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.374157    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"]
Jul 28 20:40:32.420644 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.420601    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"]
Jul 28 20:40:32.431487 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:40:32.431455    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c64bd8_99e4_4338_b864_646c4d732c42.slice/crio-65c566d40dd6b7fdf646982038c3c87b2c2c08dec9be0fd0ca56d2876db0d9c7 WatchSource:0}: Error finding container 65c566d40dd6b7fdf646982038c3c87b2c2c08dec9be0fd0ca56d2876db0d9c7: Status 404 returned error can't find the container with id 65c566d40dd6b7fdf646982038c3c87b2c2c08dec9be0fd0ca56d2876db0d9c7
Jul 28 20:40:32.438942 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.438907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9" event={"ID":"d82ae805-06b1-41df-ab75-c1f558d2d46c","Type":"ContainerStarted","Data":"f09d428fb03c1eb8fc3acd424a2f8ef64e1d05c77205be15ca2b42c031c8ce73"}
Jul 28 20:40:32.440481 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.440451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6" event={"ID":"74c64bd8-99e4-4338-b864-646c4d732c42","Type":"ContainerStarted","Data":"65c566d40dd6b7fdf646982038c3c87b2c2c08dec9be0fd0ca56d2876db0d9c7"}
Jul 28 20:40:32.441869 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:32.441847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk" event={"ID":"236dcb8f-da31-4ee4-bd90-b18b62be18d4","Type":"ContainerStarted","Data":"39cc219d3e9d168f8e6d9e47c62c0ad9b2921cf0a259714fab1d5d0a76e8db74"}
Jul 28 20:40:33.449034 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.448985    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9" event={"ID":"d82ae805-06b1-41df-ab75-c1f558d2d46c","Type":"ContainerStarted","Data":"48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc"}
Jul 28 20:40:33.449545 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.449054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:33.450684 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.450653    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6" event={"ID":"74c64bd8-99e4-4338-b864-646c4d732c42","Type":"ContainerStarted","Data":"7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde"}
Jul 28 20:40:33.450804 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.450737    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:40:33.452219 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.452199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk" event={"ID":"236dcb8f-da31-4ee4-bd90-b18b62be18d4","Type":"ContainerStarted","Data":"8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f"}
Jul 28 20:40:33.452345 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.452331    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:33.467998 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.467940    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9" podStartSLOduration=2.467920948 podStartE2EDuration="2.467920948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:40:33.466327465 +0000 UTC m=+3224.835464575" watchObservedRunningTime="2026-07-28 20:40:33.467920948 +0000 UTC m=+3224.837058057"
Jul 28 20:40:33.487447 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.487365    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk" podStartSLOduration=2.990295748 podStartE2EDuration="3.487337908s" totalImagesPullingTime="497.04216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:40:33.485493081 +0000 UTC m=+3224.854630195" watchObservedRunningTime="2026-07-28 20:40:33.487337908 +0000 UTC m=+3224.856475022"
Jul 28 20:40:33.505100 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:33.505039    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6" podStartSLOduration=2.505021379 podStartE2EDuration="2.505021379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:40:33.50419716 +0000 UTC m=+3224.873334267" watchObservedRunningTime="2026-07-28 20:40:33.505021379 +0000 UTC m=+3224.874158490"
Jul 28 20:40:39.464235 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:39.464203    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:40:44.460618 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:44.460583    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:40:44.461061 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:40:44.460668    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:41:12.195470 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.195438    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"]
Jul 28 20:41:12.196065 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.195693    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk" podUID="236dcb8f-da31-4ee4-bd90-b18b62be18d4" containerName="maas-api" containerID="cri-o://8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f" gracePeriod=30
Jul 28 20:41:12.272493 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.272299    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"]
Jul 28 20:41:12.272736 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.272566    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6" podUID="74c64bd8-99e4-4338-b864-646c4d732c42" containerName="payload-processing" containerID="cri-o://7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde" gracePeriod=30
Jul 28 20:41:12.283139 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.283104    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"]
Jul 28 20:41:12.283415 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.283387    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9" podUID="d82ae805-06b1-41df-ab75-c1f558d2d46c" containerName="payload-pre-processing" containerID="cri-o://48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc" gracePeriod=30
Jul 28 20:41:12.573929 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.573892    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:41:12.593915 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.593882    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:41:12.608655 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.608621    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:41:12.667395 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.667359    2575 generic.go:356] "Generic (PLEG): container finished" podID="d82ae805-06b1-41df-ab75-c1f558d2d46c" containerID="48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc" exitCode=0
Jul 28 20:41:12.667572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.667406    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"
Jul 28 20:41:12.667572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.667447    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9" event={"ID":"d82ae805-06b1-41df-ab75-c1f558d2d46c","Type":"ContainerDied","Data":"48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc"}
Jul 28 20:41:12.667572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.667505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9" event={"ID":"d82ae805-06b1-41df-ab75-c1f558d2d46c","Type":"ContainerDied","Data":"f09d428fb03c1eb8fc3acd424a2f8ef64e1d05c77205be15ca2b42c031c8ce73"}
Jul 28 20:41:12.667572 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.667534    2575 scope.go:117] "RemoveContainer" containerID="48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc"
Jul 28 20:41:12.669065 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.669036    2575 generic.go:356] "Generic (PLEG): container finished" podID="74c64bd8-99e4-4338-b864-646c4d732c42" containerID="7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde" exitCode=0
Jul 28 20:41:12.669211 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.669078    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"
Jul 28 20:41:12.669211 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.669107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6" event={"ID":"74c64bd8-99e4-4338-b864-646c4d732c42","Type":"ContainerDied","Data":"7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde"}
Jul 28 20:41:12.669211 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.669179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6" event={"ID":"74c64bd8-99e4-4338-b864-646c4d732c42","Type":"ContainerDied","Data":"65c566d40dd6b7fdf646982038c3c87b2c2c08dec9be0fd0ca56d2876db0d9c7"}
Jul 28 20:41:12.670690 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.670667    2575 generic.go:356] "Generic (PLEG): container finished" podID="236dcb8f-da31-4ee4-bd90-b18b62be18d4" containerID="8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f" exitCode=0
Jul 28 20:41:12.670815 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.670703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk" event={"ID":"236dcb8f-da31-4ee4-bd90-b18b62be18d4","Type":"ContainerDied","Data":"8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f"}
Jul 28 20:41:12.670815 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.670742    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk" event={"ID":"236dcb8f-da31-4ee4-bd90-b18b62be18d4","Type":"ContainerDied","Data":"39cc219d3e9d168f8e6d9e47c62c0ad9b2921cf0a259714fab1d5d0a76e8db74"}
Jul 28 20:41:12.670815 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.670711    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"
Jul 28 20:41:12.677506 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.677481    2575 scope.go:117] "RemoveContainer" containerID="48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc"
Jul 28 20:41:12.677822 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:41:12.677804    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc\": container with ID starting with 48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc not found: ID does not exist" containerID="48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc"
Jul 28 20:41:12.677878 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.677831    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc"} err="failed to get container status \"48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc\": rpc error: code = NotFound desc = could not find container \"48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc\": container with ID starting with 48abbb1d6e48574a6b99c142451b2ddfecc31f0f98f3ae0fc39933224000d6dc not found: ID does not exist"
Jul 28 20:41:12.677878 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.677848    2575 scope.go:117] "RemoveContainer" containerID="7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde"
Jul 28 20:41:12.686750 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.686728    2575 scope.go:117] "RemoveContainer" containerID="7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde"
Jul 28 20:41:12.687071 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:41:12.687046    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde\": container with ID starting with 7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde not found: ID does not exist" containerID="7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde"
Jul 28 20:41:12.687150 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.687080    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde"} err="failed to get container status \"7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde\": rpc error: code = NotFound desc = could not find container \"7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde\": container with ID starting with 7dd30a6f8d0665dd967fca884575b0d4be1956d48cf3698305bb76537ef31bde not found: ID does not exist"
Jul 28 20:41:12.687150 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.687099    2575 scope.go:117] "RemoveContainer" containerID="8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f"
Jul 28 20:41:12.696597 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.696571    2575 scope.go:117] "RemoveContainer" containerID="8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f"
Jul 28 20:41:12.697106 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:41:12.697080    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f\": container with ID starting with 8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f not found: ID does not exist" containerID="8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f"
Jul 28 20:41:12.697178 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.697115    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f"} err="failed to get container status \"8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f\": rpc error: code = NotFound desc = could not find container \"8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f\": container with ID starting with 8ceb62e33b26af670bb3ca58db7cbfd1ea573ec7249544e9c1560f635247674f not found: ID does not exist"
Jul 28 20:41:12.698379 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698348    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d82ae805-06b1-41df-ab75-c1f558d2d46c-plugins-config-volume\") pod \"d82ae805-06b1-41df-ab75-c1f558d2d46c\" (UID: \"d82ae805-06b1-41df-ab75-c1f558d2d46c\") "
Jul 28 20:41:12.698516 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698390    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5c58\" (UniqueName: \"kubernetes.io/projected/d82ae805-06b1-41df-ab75-c1f558d2d46c-kube-api-access-v5c58\") pod \"d82ae805-06b1-41df-ab75-c1f558d2d46c\" (UID: \"d82ae805-06b1-41df-ab75-c1f558d2d46c\") "
Jul 28 20:41:12.698516 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698415    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs4w5\" (UniqueName: \"kubernetes.io/projected/74c64bd8-99e4-4338-b864-646c4d732c42-kube-api-access-fs4w5\") pod \"74c64bd8-99e4-4338-b864-646c4d732c42\" (UID: \"74c64bd8-99e4-4338-b864-646c4d732c42\") "
Jul 28 20:41:12.698516 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698473    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/236dcb8f-da31-4ee4-bd90-b18b62be18d4-openshift-service-ca\") pod \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") "
Jul 28 20:41:12.699186 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698541    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg2t4\" (UniqueName: \"kubernetes.io/projected/236dcb8f-da31-4ee4-bd90-b18b62be18d4-kube-api-access-mg2t4\") pod \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") "
Jul 28 20:41:12.699186 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698579    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls\") pod \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\" (UID: \"236dcb8f-da31-4ee4-bd90-b18b62be18d4\") "
Jul 28 20:41:12.699186 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698605    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74c64bd8-99e4-4338-b864-646c4d732c42-plugins-config-volume\") pod \"74c64bd8-99e4-4338-b864-646c4d732c42\" (UID: \"74c64bd8-99e4-4338-b864-646c4d732c42\") "
Jul 28 20:41:12.699186 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698772    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d82ae805-06b1-41df-ab75-c1f558d2d46c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d82ae805-06b1-41df-ab75-c1f558d2d46c" (UID: "d82ae805-06b1-41df-ab75-c1f558d2d46c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:12.699186 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.698877    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/236dcb8f-da31-4ee4-bd90-b18b62be18d4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "236dcb8f-da31-4ee4-bd90-b18b62be18d4" (UID: "236dcb8f-da31-4ee4-bd90-b18b62be18d4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:12.699186 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.699084    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74c64bd8-99e4-4338-b864-646c4d732c42-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "74c64bd8-99e4-4338-b864-646c4d732c42" (UID: "74c64bd8-99e4-4338-b864-646c4d732c42"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:12.699460 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.699201    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d82ae805-06b1-41df-ab75-c1f558d2d46c-plugins-config-volume\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:12.699460 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.699221    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/236dcb8f-da31-4ee4-bd90-b18b62be18d4-openshift-service-ca\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:12.699460 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.699236    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74c64bd8-99e4-4338-b864-646c4d732c42-plugins-config-volume\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:12.701510 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.701478    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d82ae805-06b1-41df-ab75-c1f558d2d46c-kube-api-access-v5c58" (OuterVolumeSpecName: "kube-api-access-v5c58") pod "d82ae805-06b1-41df-ab75-c1f558d2d46c" (UID: "d82ae805-06b1-41df-ab75-c1f558d2d46c"). InnerVolumeSpecName "kube-api-access-v5c58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:12.701510 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.701489    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "236dcb8f-da31-4ee4-bd90-b18b62be18d4" (UID: "236dcb8f-da31-4ee4-bd90-b18b62be18d4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:41:12.701680 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.701588    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74c64bd8-99e4-4338-b864-646c4d732c42-kube-api-access-fs4w5" (OuterVolumeSpecName: "kube-api-access-fs4w5") pod "74c64bd8-99e4-4338-b864-646c4d732c42" (UID: "74c64bd8-99e4-4338-b864-646c4d732c42"). InnerVolumeSpecName "kube-api-access-fs4w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:12.701680 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.701627    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/236dcb8f-da31-4ee4-bd90-b18b62be18d4-kube-api-access-mg2t4" (OuterVolumeSpecName: "kube-api-access-mg2t4") pod "236dcb8f-da31-4ee4-bd90-b18b62be18d4" (UID: "236dcb8f-da31-4ee4-bd90-b18b62be18d4"). InnerVolumeSpecName "kube-api-access-mg2t4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:12.800669 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.800631    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg2t4\" (UniqueName: \"kubernetes.io/projected/236dcb8f-da31-4ee4-bd90-b18b62be18d4-kube-api-access-mg2t4\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:12.800669 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.800666    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/236dcb8f-da31-4ee4-bd90-b18b62be18d4-maas-api-tls\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:12.800902 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.800679    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5c58\" (UniqueName: \"kubernetes.io/projected/d82ae805-06b1-41df-ab75-c1f558d2d46c-kube-api-access-v5c58\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:12.800902 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.800693    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs4w5\" (UniqueName: \"kubernetes.io/projected/74c64bd8-99e4-4338-b864-646c4d732c42-kube-api-access-fs4w5\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:12.997277 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:12.997228    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"]
Jul 28 20:41:13.000637 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:13.000604    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9"]
Jul 28 20:41:13.020616 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:13.020575    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"]
Jul 28 20:41:13.060951 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:13.060864    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-579f3e-684444666f-57wfk"]
Jul 28 20:41:13.089307 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:13.089268    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"]
Jul 28 20:41:13.091179 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:13.091137    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6"]
Jul 28 20:41:13.260232 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:13.260186    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="236dcb8f-da31-4ee4-bd90-b18b62be18d4" path="/var/lib/kubelet/pods/236dcb8f-da31-4ee4-bd90-b18b62be18d4/volumes"
Jul 28 20:41:13.260768 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:13.260746    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74c64bd8-99e4-4338-b864-646c4d732c42" path="/var/lib/kubelet/pods/74c64bd8-99e4-4338-b864-646c4d732c42/volumes"
Jul 28 20:41:13.261147 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:13.261128    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d82ae805-06b1-41df-ab75-c1f558d2d46c" path="/var/lib/kubelet/pods/d82ae805-06b1-41df-ab75-c1f558d2d46c/volumes"
Jul 28 20:41:39.533990 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.533953    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"]
Jul 28 20:41:39.534590 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.534194    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz" podUID="5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" containerName="maas-api" containerID="cri-o://31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2" gracePeriod=30
Jul 28 20:41:39.646978 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.646940    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"]
Jul 28 20:41:39.647225 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.647198    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br" podUID="8071ee20-cf6a-4627-958c-c3f112d1ca95" containerName="payload-processing" containerID="cri-o://79d3ffc438aaf8439ff85877b6730a57732ff4e7752e5938a8a3c8060b586fab" gracePeriod=30
Jul 28 20:41:39.816707 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.816677    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:41:39.819300 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.819267    2575 generic.go:356] "Generic (PLEG): container finished" podID="5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" containerID="31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2" exitCode=0
Jul 28 20:41:39.819453 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.819370    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"
Jul 28 20:41:39.819453 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.819383    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz" event={"ID":"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b","Type":"ContainerDied","Data":"31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2"}
Jul 28 20:41:39.819453 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.819439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz" event={"ID":"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b","Type":"ContainerDied","Data":"faae5865f8ab4dd753d6a3d91b58355155fd5d543395f0fa87ae46231b15fa53"}
Jul 28 20:41:39.819606 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.819468    2575 scope.go:117] "RemoveContainer" containerID="31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2"
Jul 28 20:41:39.820942 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.820917    2575 generic.go:356] "Generic (PLEG): container finished" podID="8071ee20-cf6a-4627-958c-c3f112d1ca95" containerID="79d3ffc438aaf8439ff85877b6730a57732ff4e7752e5938a8a3c8060b586fab" exitCode=0
Jul 28 20:41:39.821051 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.821023    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br" event={"ID":"8071ee20-cf6a-4627-958c-c3f112d1ca95","Type":"ContainerDied","Data":"79d3ffc438aaf8439ff85877b6730a57732ff4e7752e5938a8a3c8060b586fab"}
Jul 28 20:41:39.832977 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.832940    2575 scope.go:117] "RemoveContainer" containerID="31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2"
Jul 28 20:41:39.833622 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:41:39.833573    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2\": container with ID starting with 31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2 not found: ID does not exist" containerID="31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2"
Jul 28 20:41:39.833746 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.833655    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2"} err="failed to get container status \"31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2\": rpc error: code = NotFound desc = could not find container \"31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2\": container with ID starting with 31a9cf5d56e140991ad1565e90c0111dd9ee81a7b07f05c8a18fdb4299e603d2 not found: ID does not exist"
Jul 28 20:41:39.879902 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.879871    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-maas-api-tls\") pod \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") "
Jul 28 20:41:39.880089 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.879912    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvc5t\" (UniqueName: \"kubernetes.io/projected/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-kube-api-access-vvc5t\") pod \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") "
Jul 28 20:41:39.880089 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.880062    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-openshift-service-ca\") pod \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\" (UID: \"5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b\") "
Jul 28 20:41:39.880452 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.880429    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" (UID: "5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:39.883721 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.883693    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-kube-api-access-vvc5t" (OuterVolumeSpecName: "kube-api-access-vvc5t") pod "5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" (UID: "5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b"). InnerVolumeSpecName "kube-api-access-vvc5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:39.883721 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.883702    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" (UID: "5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:41:39.938622 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.938586    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:41:39.981013 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.980979    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8071ee20-cf6a-4627-958c-c3f112d1ca95-plugins-config-volume\") pod \"8071ee20-cf6a-4627-958c-c3f112d1ca95\" (UID: \"8071ee20-cf6a-4627-958c-c3f112d1ca95\") "
Jul 28 20:41:39.981219 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.981073    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zzg9\" (UniqueName: \"kubernetes.io/projected/8071ee20-cf6a-4627-958c-c3f112d1ca95-kube-api-access-9zzg9\") pod \"8071ee20-cf6a-4627-958c-c3f112d1ca95\" (UID: \"8071ee20-cf6a-4627-958c-c3f112d1ca95\") "
Jul 28 20:41:39.981328 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.981314    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-maas-api-tls\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:39.981367 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.981335    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvc5t\" (UniqueName: \"kubernetes.io/projected/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-kube-api-access-vvc5t\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:39.981367 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.981347    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b-openshift-service-ca\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:39.981432 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.981366    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8071ee20-cf6a-4627-958c-c3f112d1ca95-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8071ee20-cf6a-4627-958c-c3f112d1ca95" (UID: "8071ee20-cf6a-4627-958c-c3f112d1ca95"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:41:39.983454 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:39.983419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8071ee20-cf6a-4627-958c-c3f112d1ca95-kube-api-access-9zzg9" (OuterVolumeSpecName: "kube-api-access-9zzg9") pod "8071ee20-cf6a-4627-958c-c3f112d1ca95" (UID: "8071ee20-cf6a-4627-958c-c3f112d1ca95"). InnerVolumeSpecName "kube-api-access-9zzg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:41:40.082562 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.082466    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zzg9\" (UniqueName: \"kubernetes.io/projected/8071ee20-cf6a-4627-958c-c3f112d1ca95-kube-api-access-9zzg9\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:40.082562 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.082504    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8071ee20-cf6a-4627-958c-c3f112d1ca95-plugins-config-volume\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:41:40.162606 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.162569    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"]
Jul 28 20:41:40.170820 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.170785    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-92ba10-5f5d77fc4d-jxcfz"]
Jul 28 20:41:40.827955 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.827872    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"
Jul 28 20:41:40.828418 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.827868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br" event={"ID":"8071ee20-cf6a-4627-958c-c3f112d1ca95","Type":"ContainerDied","Data":"8d2a608f333f605cb309c749c9fdd61675c64c8a3f52d0d0744fac0dfb1ccff3"}
Jul 28 20:41:40.828418 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.828012    2575 scope.go:117] "RemoveContainer" containerID="79d3ffc438aaf8439ff85877b6730a57732ff4e7752e5938a8a3c8060b586fab"
Jul 28 20:41:40.865126 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.865093    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"]
Jul 28 20:41:40.870042 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:40.870008    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br"]
Jul 28 20:41:41.258652 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:41.258611    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" path="/var/lib/kubelet/pods/5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b/volumes"
Jul 28 20:41:41.259032 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:41:41.259018    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8071ee20-cf6a-4627-958c-c3f112d1ca95" path="/var/lib/kubelet/pods/8071ee20-cf6a-4627-958c-c3f112d1ca95/volumes"
Jul 28 20:42:54.801534 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:42:54.801502    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"]
Jul 28 20:42:54.802071 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:42:54.801715    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy" containerID="cri-o://88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4" gracePeriod=30
Jul 28 20:42:57.379703 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:42:57.379672    2575 patch_prober.go:28] interesting pod/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:42:57.380127 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:42:57.379754    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:43:00.079282 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.079249    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:43:00.160387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160353    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-credential-socket\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160387 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160395    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-certs\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160638 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160470    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-token\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160638 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160522    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-envoy\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160638 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160581    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-socket\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160638 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160612    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istiod-ca-cert\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160638 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160638    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-podinfo\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160905 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160674    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-data\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160905 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160717    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsrgp\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-kube-api-access-bsrgp\") pod \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\" (UID: \"950dfed3-3dc4-4a1f-8433-dba26268b1ba\") "
Jul 28 20:43:00.160905 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160753    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:00.160905 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160774    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:00.160905 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.160890    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:00.161205 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.161108    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-credential-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.161205 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.161128    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-certs\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.161205 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.161142    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-workload-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.161581 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.161558    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:43:00.161872 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.161846    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:00.162995 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.162972    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:00.163320 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.163296    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-kube-api-access-bsrgp" (OuterVolumeSpecName: "kube-api-access-bsrgp") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "kube-api-access-bsrgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:43:00.163455 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.163426    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:43:00.163555 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.163452    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "950dfed3-3dc4-4a1f-8433-dba26268b1ba" (UID: "950dfed3-3dc4-4a1f-8433-dba26268b1ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:43:00.250356 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.250321    2575 generic.go:356] "Generic (PLEG): container finished" podID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerID="88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4" exitCode=0
Jul 28 20:43:00.250566 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.250372    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"
Jul 28 20:43:00.250566 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.250406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" event={"ID":"950dfed3-3dc4-4a1f-8433-dba26268b1ba","Type":"ContainerDied","Data":"88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4"}
Jul 28 20:43:00.250566 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.250503    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77" event={"ID":"950dfed3-3dc4-4a1f-8433-dba26268b1ba","Type":"ContainerDied","Data":"94149971a0071c8605ed57429486f0e555d4b3c615ff83ff3669141f2e8fc5e8"}
Jul 28 20:43:00.250566 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.250534    2575 scope.go:117] "RemoveContainer" containerID="88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4"
Jul 28 20:43:00.261349 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.261328    2575 scope.go:117] "RemoveContainer" containerID="ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d"
Jul 28 20:43:00.261764 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.261746    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-token\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.261823 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.261769    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-envoy\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.261823 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.261778    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istiod-ca-cert\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.261823 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.261786    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-podinfo\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.261823 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.261794    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/950dfed3-3dc4-4a1f-8433-dba26268b1ba-istio-data\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.261823 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.261803    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsrgp\" (UniqueName: \"kubernetes.io/projected/950dfed3-3dc4-4a1f-8433-dba26268b1ba-kube-api-access-bsrgp\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:00.270548 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.270527    2575 scope.go:117] "RemoveContainer" containerID="88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4"
Jul 28 20:43:00.270906 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:43:00.270885    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4\": container with ID starting with 88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4 not found: ID does not exist" containerID="88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4"
Jul 28 20:43:00.270986 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.270918    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4"} err="failed to get container status \"88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4\": rpc error: code = NotFound desc = could not find container \"88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4\": container with ID starting with 88ffb4c064a5e0df44ff736917c87bd77a6d1ce97b978d0a941cc1ce36d7e9b4 not found: ID does not exist"
Jul 28 20:43:00.270986 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.270944    2575 scope.go:117] "RemoveContainer" containerID="ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d"
Jul 28 20:43:00.271251 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:43:00.271232    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d\": container with ID starting with ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d not found: ID does not exist" containerID="ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d"
Jul 28 20:43:00.271291 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.271259    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d"} err="failed to get container status \"ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d\": rpc error: code = NotFound desc = could not find container \"ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d\": container with ID starting with ea81592fb4accd726d38ce0b4908564d1fcaefc66d34d0e8ceb0b6af09b88b1d not found: ID does not exist"
Jul 28 20:43:00.278078 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.278046    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"]
Jul 28 20:43:00.282241 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:00.282208    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77"]
Jul 28 20:43:01.259083 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:01.259046    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" path="/var/lib/kubelet/pods/950dfed3-3dc4-4a1f-8433-dba26268b1ba/volumes"
Jul 28 20:43:34.130308 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:34.130266    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"]
Jul 28 20:43:34.130898 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:34.130479    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy" containerID="cri-o://663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a" gracePeriod=30
Jul 28 20:43:34.883879 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:34.883840    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769b854499-6rh2j_a4974522-5e2b-471c-9930-6780bc6d1b42/authorino/0.log"
Jul 28 20:43:35.395480 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:35.395436    2575 patch_prober.go:28] interesting pod/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:43:35.395938 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:35.395499    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:43:39.386582 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.386555    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:43:39.443039 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.442947    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-podinfo\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443039 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.442988    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0dfcbb-3fee-4053-a467-ced45195b55a-istiod-ca-cert\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443039 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443020    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-envoy\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443349 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443052    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-credential-socket\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443349 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443226    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szdrm\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-kube-api-access-szdrm\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443349 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443278    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-token\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443513 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443356    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-socket\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443513 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443395    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-data\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443513 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443400    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:39.443513 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443443    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-certs\") pod \"5b0dfcbb-3fee-4053-a467-ced45195b55a\" (UID: \"5b0dfcbb-3fee-4053-a467-ced45195b55a\") "
Jul 28 20:43:39.443513 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443493    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0dfcbb-3fee-4053-a467-ced45195b55a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:43:39.443944 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443749    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:39.444062 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.443996    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:39.444062 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.444019    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b0dfcbb-3fee-4053-a467-ced45195b55a-istiod-ca-cert\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:39.444062 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.444033    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-credential-socket\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:39.444305 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.444248    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:39.444811 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.444650    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:39.445917 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.445851    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:43:39.445917 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.445868    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:43:39.446085 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.446043    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:43:39.446143 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.446097    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-kube-api-access-szdrm" (OuterVolumeSpecName: "kube-api-access-szdrm") pod "5b0dfcbb-3fee-4053-a467-ced45195b55a" (UID: "5b0dfcbb-3fee-4053-a467-ced45195b55a"). InnerVolumeSpecName "kube-api-access-szdrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:43:39.446560 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.446529    2575 generic.go:356] "Generic (PLEG): container finished" podID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerID="663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a" exitCode=0
Jul 28 20:43:39.446681 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.446657    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"
Jul 28 20:43:39.446756 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.446708    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" event={"ID":"5b0dfcbb-3fee-4053-a467-ced45195b55a","Type":"ContainerDied","Data":"663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a"}
Jul 28 20:43:39.446818 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.446776    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4" event={"ID":"5b0dfcbb-3fee-4053-a467-ced45195b55a","Type":"ContainerDied","Data":"282453f71041f6db42561b2f6b79e51cd14dc7a838971cc42cb781dbdf33c239"}
Jul 28 20:43:39.446818 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.446807    2575 scope.go:117] "RemoveContainer" containerID="663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a"
Jul 28 20:43:39.467488 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.467460    2575 scope.go:117] "RemoveContainer" containerID="3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5"
Jul 28 20:43:39.476597 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.476577    2575 scope.go:117] "RemoveContainer" containerID="663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a"
Jul 28 20:43:39.476909 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:43:39.476891    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a\": container with ID starting with 663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a not found: ID does not exist" containerID="663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a"
Jul 28 20:43:39.476949 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.476922    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a"} err="failed to get container status \"663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a\": rpc error: code = NotFound desc = could not find container \"663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a\": container with ID starting with 663a30b195fcf1ca01c33ce2c94b90a67a9d0b0e47dfcfc0951ee48e9d52e30a not found: ID does not exist"
Jul 28 20:43:39.476949 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.476943    2575 scope.go:117] "RemoveContainer" containerID="3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5"
Jul 28 20:43:39.477234 ip-10-0-128-236 kubenswrapper[2575]: E0728 20:43:39.477212    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5\": container with ID starting with 3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5 not found: ID does not exist" containerID="3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5"
Jul 28 20:43:39.477283 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.477257    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5"} err="failed to get container status \"3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5\": rpc error: code = NotFound desc = could not find container \"3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5\": container with ID starting with 3435507bc4e0d88b35faccae1875d462227c7dde65343ed9463224cf09cac7f5 not found: ID does not exist"
Jul 28 20:43:39.496196 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.496146    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"]
Jul 28 20:43:39.502752 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.502726    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4"]
Jul 28 20:43:39.545390 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.545352    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-workload-certs\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:39.545390 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.545385    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-podinfo\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:39.545390 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.545394    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-envoy\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:39.545654 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.545404    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szdrm\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-kube-api-access-szdrm\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:39.545654 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.545415    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-token\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:39.545654 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:39.545423    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b0dfcbb-3fee-4053-a467-ced45195b55a-istio-data\") on node \"ip-10-0-128-236.ec2.internal\" DevicePath \"\""
Jul 28 20:43:40.730575 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:40.730541    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-z9fbn_c2e1397b-4ef8-4abf-a855-d29161e45e0d/manager/0.log"
Jul 28 20:43:41.102883 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:41.102758    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qp2jq_fd61d2be-22b2-4a75-a5e2-97c2725d7750/server/0.log"
Jul 28 20:43:41.221480 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:41.221442    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2sht7_615eb736-5a59-470f-81cd-f1182ebe0dec/manager/0.log"
Jul 28 20:43:41.259318 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:41.259284    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" path="/var/lib/kubelet/pods/5b0dfcbb-3fee-4053-a467-ced45195b55a/volumes"
Jul 28 20:43:41.633807 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:41.633778    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85967bc8b9-qwvzp_5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1/copy-manifests/0.log"
Jul 28 20:43:41.644460 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:41.644411    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85967bc8b9-qwvzp_5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1/manager/0.log"
Jul 28 20:43:42.001751 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:42.001704    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5f588fc9bf-6dh6l_b316111e-eab4-40a1-af2c-6961f38a7d06/maas-api/0.log"
Jul 28 20:43:42.476114 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:42.476035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jpmcv_632dcd72-111a-497c-97fa-aae4ea3d5fdd/postgres/0.log"
Jul 28 20:43:43.863836 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:43.863800    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769b854499-6rh2j_a4974522-5e2b-471c-9930-6780bc6d1b42/authorino/0.log"
Jul 28 20:43:44.003155 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:44.003126    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s7zpl_dc1e8dce-2971-4f46-91ec-83751edb1c08/manager/0.log"
Jul 28 20:43:44.125139 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:44.125046    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-b5cwj_4f32d061-699f-4036-9239-9afc9f5ee387/manager/0.log"
Jul 28 20:43:44.237038 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:44.237011    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qwcvr_2166cd85-e9d5-4d8b-8838-f6de91040918/kuadrant-console-plugin/0.log"
Jul 28 20:43:44.356627 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:44.356599    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-64cgr_243dcbc0-5464-42e2-9a12-45d435930862/registry-server/0.log"
Jul 28 20:43:44.720706 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:44.720670    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hgpbv_61063d9e-396f-4f4d-b2b0-9708c3d5bd01/manager/0.log"
Jul 28 20:43:45.090437 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:45.090405    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f_6eb3cd9d-f725-4eb0-9850-f78357fd41fe/istio-proxy/0.log"
Jul 28 20:43:45.494161 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:45.494105    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-579d8dfb47-nh8bj_006712fe-6990-4b24-b581-30925a333721/kube-auth-proxy/0.log"
Jul 28 20:43:45.629666 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:45.629638    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zvf29_81cbf011-0d2d-44aa-b31f-5144af101d24/istio-proxy/1.log"
Jul 28 20:43:46.813209 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:46.813182    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ltr2d_6666fe9f-555c-4149-bad3-d9873b42cc6c/payload-pre-processing/0.log"
Jul 28 20:43:46.938219 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:46.938181    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tnwkf_cfaf35c8-de5c-4cb4-ae36-e80829ecc97e/payload-processing/0.log"
Jul 28 20:43:47.593819 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:47.593769    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-nb96p_8e430dc2-b4df-41ca-954d-4a596da76052/main/0.log"
Jul 28 20:43:47.734562 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:47.734535    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-g8hlq_dec2cb4e-f3b2-43ee-9453-14e2c8dcb611/main/0.log"
Jul 28 20:43:47.987854 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:47.987824    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xvr6j_b35ffc14-2194-46f4-a6fa-dc912de2c9b6/main/0.log"
Jul 28 20:43:48.113859 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:43:48.113811    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-ntfg9_0f58bdd5-e584-4134-9823-2c31a1c090d0/main/0.log"
Jul 28 20:44:23.304064 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:23.304026    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5fgtz_29481a0e-8d07-408c-8ab4-69b8db682394/global-pull-secret-syncer/0.log"
Jul 28 20:44:23.552845 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:23.552804    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qrhll_7f036892-882f-448d-9dec-b5e936bd831a/konnectivity-agent/0.log"
Jul 28 20:44:23.578148 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:23.578060    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-236.ec2.internal_0a426c9c0dc23284d58a8b55be14deec/haproxy/0.log"
Jul 28 20:44:28.715974 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:28.715931    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-769b854499-6rh2j_a4974522-5e2b-471c-9930-6780bc6d1b42/authorino/0.log"
Jul 28 20:44:28.759048 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:28.759015    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s7zpl_dc1e8dce-2971-4f46-91ec-83751edb1c08/manager/0.log"
Jul 28 20:44:28.795037 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:28.795005    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-b5cwj_4f32d061-699f-4036-9239-9afc9f5ee387/manager/0.log"
Jul 28 20:44:28.835564 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:28.835539    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qwcvr_2166cd85-e9d5-4d8b-8838-f6de91040918/kuadrant-console-plugin/0.log"
Jul 28 20:44:28.893796 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:28.893759    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-64cgr_243dcbc0-5464-42e2-9a12-45d435930862/registry-server/0.log"
Jul 28 20:44:29.202577 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:29.202541    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hgpbv_61063d9e-396f-4f4d-b2b0-9708c3d5bd01/manager/0.log"
Jul 28 20:44:31.493286 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:31.493258    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tbh56_9d833780-bf13-42b7-8e1f-f2498fe9cacb/node-exporter/0.log"
Jul 28 20:44:31.518911 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:31.518885    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tbh56_9d833780-bf13-42b7-8e1f-f2498fe9cacb/kube-rbac-proxy/0.log"
Jul 28 20:44:31.546497 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:31.546469    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tbh56_9d833780-bf13-42b7-8e1f-f2498fe9cacb/init-textfile/0.log"
Jul 28 20:44:33.019428 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019394    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"]
Jul 28 20:44:33.019819 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019780    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy"
Jul 28 20:44:33.019819 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019790    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy"
Jul 28 20:44:33.019819 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019798    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c64bd8-99e4-4338-b864-646c4d732c42" containerName="payload-processing"
Jul 28 20:44:33.019819 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019804    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c64bd8-99e4-4338-b864-646c4d732c42" containerName="payload-processing"
Jul 28 20:44:33.019819 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019811    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy"
Jul 28 20:44:33.019819 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019819    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019826    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d82ae805-06b1-41df-ab75-c1f558d2d46c" containerName="payload-pre-processing"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019831    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d82ae805-06b1-41df-ab75-c1f558d2d46c" containerName="payload-pre-processing"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019839    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8071ee20-cf6a-4627-958c-c3f112d1ca95" containerName="payload-processing"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019845    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8071ee20-cf6a-4627-958c-c3f112d1ca95" containerName="payload-processing"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019858    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019863    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019868    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" containerName="maas-api"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019873    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" containerName="maas-api"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019878    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019884    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019891    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236dcb8f-da31-4ee4-bd90-b18b62be18d4" containerName="maas-api"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019896    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="236dcb8f-da31-4ee4-bd90-b18b62be18d4" containerName="maas-api"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019948    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a46f4c8-ea5a-4e28-a08c-b2bb1bd70a5b" containerName="maas-api"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019955    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d82ae805-06b1-41df-ab75-c1f558d2d46c" containerName="payload-pre-processing"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019963    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019969    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0dfcbb-3fee-4053-a467-ced45195b55a" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019974    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019979    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c64bd8-99e4-4338-b864-646c4d732c42" containerName="payload-processing"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019984    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="950dfed3-3dc4-4a1f-8433-dba26268b1ba" containerName="istio-proxy"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019989    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8071ee20-cf6a-4627-958c-c3f112d1ca95" containerName="payload-processing"
Jul 28 20:44:33.020008 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.019994    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="236dcb8f-da31-4ee4-bd90-b18b62be18d4" containerName="maas-api"
Jul 28 20:44:33.030141 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.030116    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.034498 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.034468    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bz499\"/\"default-dockercfg-mdklh\""
Jul 28 20:44:33.034498 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.034473    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bz499\"/\"kube-root-ca.crt\""
Jul 28 20:44:33.034679 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.034515    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bz499\"/\"openshift-service-ca.crt\""
Jul 28 20:44:33.051714 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.051673    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"]
Jul 28 20:44:33.145621 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.145584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-lib-modules\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.145808 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.145647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-proc\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.145808 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.145738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-sys\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.145808 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.145784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkl5h\" (UniqueName: \"kubernetes.io/projected/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-kube-api-access-hkl5h\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.145919 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.145856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-podres\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.246781 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.246721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-proc\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.247003 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.246810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-sys\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.247003 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.246837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkl5h\" (UniqueName: \"kubernetes.io/projected/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-kube-api-access-hkl5h\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.247003 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.246859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-proc\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.247003 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.246874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-podres\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.247003 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.246944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-sys\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.247003 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.246992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-podres\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.247003 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.247002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-lib-modules\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.247313 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.247140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-lib-modules\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.256114 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.256087    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkl5h\" (UniqueName: \"kubernetes.io/projected/b2f664e7-6b3e-46ec-aab3-70ccd24d5c35-kube-api-access-hkl5h\") pod \"perf-node-gather-daemonset-r7cjj\" (UID: \"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35\") " pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.340733 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.340641    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.485804 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.485777    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"]
Jul 28 20:44:33.487589 ip-10-0-128-236 kubenswrapper[2575]: W0728 20:44:33.487558    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb2f664e7_6b3e_46ec_aab3_70ccd24d5c35.slice/crio-9b51f7b375c133180cd7f86b45dd899d2f9b21876b88c84f13cc6b21942fb45f WatchSource:0}: Error finding container 9b51f7b375c133180cd7f86b45dd899d2f9b21876b88c84f13cc6b21942fb45f: Status 404 returned error can't find the container with id 9b51f7b375c133180cd7f86b45dd899d2f9b21876b88c84f13cc6b21942fb45f
Jul 28 20:44:33.713745 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.713706    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj" event={"ID":"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35","Type":"ContainerStarted","Data":"8fe12589b7a1d00a8af4e01c588997e597b94458b82c5f95f7467a9380e57fab"}
Jul 28 20:44:33.713913 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.713765    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj" event={"ID":"b2f664e7-6b3e-46ec-aab3-70ccd24d5c35","Type":"ContainerStarted","Data":"9b51f7b375c133180cd7f86b45dd899d2f9b21876b88c84f13cc6b21942fb45f"}
Jul 28 20:44:33.713913 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.713829    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:33.735730 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:33.735673    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj" podStartSLOduration=1.735656366 podStartE2EDuration="1.735656366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:44:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:44:33.733844966 +0000 UTC m=+3465.102982089" watchObservedRunningTime="2026-07-28 20:44:33.735656366 +0000 UTC m=+3465.104793477"
Jul 28 20:44:36.552053 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:36.552022    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c6qcg_8b2a401b-408e-4a7d-950c-439b1fe45b2b/dns/0.log"
Jul 28 20:44:36.600081 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:36.600053    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c6qcg_8b2a401b-408e-4a7d-950c-439b1fe45b2b/kube-rbac-proxy/0.log"
Jul 28 20:44:37.033445 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:37.033415    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ppn7s_7fc8b706-2189-4aae-9524-85c23861686b/dns-node-resolver/0.log"
Jul 28 20:44:37.682439 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:37.682407    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b9785d688-fr2pt_539a6f8b-19ef-475c-8222-7446d2b343b2/registry/0.log"
Jul 28 20:44:37.826739 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:37.826711    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w64pz_10cc32c5-1a06-42fe-81c0-a1f8b942496b/node-ca/0.log"
Jul 28 20:44:38.886398 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:38.886371    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f_6eb3cd9d-f725-4eb0-9850-f78357fd41fe/istio-proxy/0.log"
Jul 28 20:44:39.114400 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:39.114367    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-579d8dfb47-nh8bj_006712fe-6990-4b24-b581-30925a333721/kube-auth-proxy/0.log"
Jul 28 20:44:39.154361 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:39.154279    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zvf29_81cbf011-0d2d-44aa-b31f-5144af101d24/istio-proxy/0.log"
Jul 28 20:44:39.177625 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:39.177593    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zvf29_81cbf011-0d2d-44aa-b31f-5144af101d24/istio-proxy/1.log"
Jul 28 20:44:39.216264 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:39.216233    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ltr2d_6666fe9f-555c-4149-bad3-d9873b42cc6c/payload-pre-processing/0.log"
Jul 28 20:44:39.248263 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:39.248231    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tnwkf_cfaf35c8-de5c-4cb4-ae36-e80829ecc97e/payload-processing/0.log"
Jul 28 20:44:39.731041 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:39.731004    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bz499/perf-node-gather-daemonset-r7cjj"
Jul 28 20:44:40.246384 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:40.246357    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pzgh8_13d39a56-8c65-4078-8c72-800f55399d95/serve-healthcheck-canary/0.log"
Jul 28 20:44:40.827440 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:40.827413    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9swpc_95002a34-c9fa-467c-8cfe-93f289f3eb56/kube-rbac-proxy/0.log"
Jul 28 20:44:40.853455 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:40.853432    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9swpc_95002a34-c9fa-467c-8cfe-93f289f3eb56/exporter/0.log"
Jul 28 20:44:40.881000 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:40.880970    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9swpc_95002a34-c9fa-467c-8cfe-93f289f3eb56/extractor/0.log"
Jul 28 20:44:43.145304 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:43.145274    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f_6eb3cd9d-f725-4eb0-9850-f78357fd41fe/istio-proxy/0.log"
Jul 28 20:44:43.376113 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:43.376082    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-579d8dfb47-nh8bj_006712fe-6990-4b24-b581-30925a333721/kube-auth-proxy/0.log"
Jul 28 20:44:43.404467 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:43.404437    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zvf29_81cbf011-0d2d-44aa-b31f-5144af101d24/istio-proxy/0.log"
Jul 28 20:44:43.428488 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:43.428459    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zvf29_81cbf011-0d2d-44aa-b31f-5144af101d24/istio-proxy/1.log"
Jul 28 20:44:43.462553 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:43.462525    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ltr2d_6666fe9f-555c-4149-bad3-d9873b42cc6c/payload-pre-processing/0.log"
Jul 28 20:44:43.488518 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:43.488497    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tnwkf_cfaf35c8-de5c-4cb4-ae36-e80829ecc97e/payload-processing/0.log"
Jul 28 20:44:43.513739 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:43.513718    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-z9fbn_c2e1397b-4ef8-4abf-a855-d29161e45e0d/manager/0.log"
Jul 28 20:44:44.014654 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:44.014625    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qp2jq_fd61d2be-22b2-4a75-a5e2-97c2725d7750/server/0.log"
Jul 28 20:44:44.097108 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:44.097075    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2sht7_615eb736-5a59-470f-81cd-f1182ebe0dec/manager/0.log"
Jul 28 20:44:44.482834 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:44.482770    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85967bc8b9-qwvzp_5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1/manager/0.log"
Jul 28 20:44:44.563020 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:44.562997    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85967bc8b9-qwvzp_5ae12ed3-f3c8-4f90-b2f8-f1cc033850b1/copy-manifests/0.log"
Jul 28 20:44:44.983445 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:44.983407    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f_6eb3cd9d-f725-4eb0-9850-f78357fd41fe/istio-proxy/0.log"
Jul 28 20:44:45.207368 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:45.207342    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-579d8dfb47-nh8bj_006712fe-6990-4b24-b581-30925a333721/kube-auth-proxy/0.log"
Jul 28 20:44:45.272348 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:45.272238    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zvf29_81cbf011-0d2d-44aa-b31f-5144af101d24/istio-proxy/0.log"
Jul 28 20:44:45.296523 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:45.296493    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zvf29_81cbf011-0d2d-44aa-b31f-5144af101d24/istio-proxy/1.log"
Jul 28 20:44:45.320657 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:45.320626    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-ltr2d_6666fe9f-555c-4149-bad3-d9873b42cc6c/payload-pre-processing/0.log"
Jul 28 20:44:45.348798 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:45.348772    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-tnwkf_cfaf35c8-de5c-4cb4-ae36-e80829ecc97e/payload-processing/0.log"
Jul 28 20:44:51.213225 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:51.213190    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-87wrd_828d02b5-014c-4a4e-9e85-70d4ff4bf722/migrator/0.log"
Jul 28 20:44:51.272031 ip-10-0-128-236 kubenswrapper[2575]: I0728 20:44:51.271994    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-87wrd_828d02b5-014c-4a4e-9e85-70d4ff4bf722/graceful-termination/0.log"