Jul 27 20:57:34.414117 ip-10-0-131-197 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 20:57:34.783376 ip-10-0-131-197 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:57:34.783376 ip-10-0-131-197 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 20:57:34.783376 ip-10-0-131-197 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:57:34.783376 ip-10-0-131-197 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 20:57:34.783376 ip-10-0-131-197 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 20:57:34.784156 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.783436    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 20:57:34.788493 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788474    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:34.788493 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788494    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788498    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788502    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788505    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788508    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788511    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788513    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788516    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788519    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788521    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788525    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788528    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788530    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788533    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788535    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788538    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788541    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788543    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788546    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788548    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:34.788570 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788551    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788553    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788556    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788558    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788561    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788563    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788566    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788569    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788571    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788574    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788577    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788580    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788583    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788585    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788588    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788591    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788594    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788597    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788599    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788602    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:34.789064 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788605    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788608    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788610    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788612    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788615    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788617    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788620    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788623    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788625    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788628    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788630    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788632    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788635    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788638    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788641    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788644    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788646    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788649    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788651    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788654    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:34.789543 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788656    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788659    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788661    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788664    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788666    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788669    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788671    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788674    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788676    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788679    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788681    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788684    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788686    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788689    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788691    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788694    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788696    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788699    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788703    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:34.790033 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788709    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788714    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788718    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788721    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788724    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788728    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788731    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788734    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788736    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788739    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788741    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788744    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788747    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788749    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788753    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788757    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788760    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788764    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.788767    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:34.790490 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789607    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789619    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789625    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789630    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789633    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789636    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789639    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789643    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789648    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789651    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789654    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789656    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789659    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789662    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789664    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789669    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789673    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789676    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:34.790973 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789679    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789682    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789684    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789687    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789690    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789692    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789695    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789698    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789700    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789703    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789705    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789708    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789710    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789712    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789715    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789719    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789722    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789724    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789727    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789730    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:34.791463 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789733    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789735    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789738    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789740    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789742    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789745    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789748    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789750    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789753    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789755    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789757    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789760    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789762    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789765    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789767    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789770    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789773    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789775    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789778    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:34.792005 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789780    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789782    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789801    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789804    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789806    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789809    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789812    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789815    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789818    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789821    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789824    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789826    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789829    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789831    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789834    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789838    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789840    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789842    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789845    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789848    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:34.792482 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789850    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789853    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789855    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789858    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789860    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789864    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789866    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789869    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789871    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789874    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789876    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789879    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789881    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789884    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789887    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789889    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789891    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789894    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789897    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789899    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:34.792986 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789902    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.789905    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790306    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790311    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790314    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790317    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790319    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790322    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790325    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790327    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790330    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790332    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790335    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790338    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790340    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790343    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790345    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790348    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790351    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790357    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:34.793470 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790359    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790362    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790364    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790367    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790369    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790372    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790375    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790377    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790380    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790382    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790385    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790387    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790391    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790393    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790396    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790399    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790401    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790404    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790406    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790409    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:34.793965 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790412    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790414    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790418    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790422    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790425    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790427    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790430    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790432    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790435    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790437    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790440    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790442    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790445    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790448    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790450    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790452    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790455    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790457    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790460    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790462    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:34.794451 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790465    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790468    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790470    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790473    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790479    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790482    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790484    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790487    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790490    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790493    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790495    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790498    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790500    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790503    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790507    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790509    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790512    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790514    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790517    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790519    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:34.794961 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790522    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790524    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790526    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790529    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790531    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790534    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790536    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790538    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790542    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790546    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790550    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790554    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790557    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790560    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790563    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790566    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790569    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790571    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790574    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:34.795441 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790576    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.790579    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790654    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790665    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790675    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790682    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790689    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790693    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790697    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790702    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790705    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790708    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790711    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790715    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790718    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790721    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790723    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790726    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790729    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790732    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790736    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790739    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790742    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790746    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 20:57:34.795931 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790749    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790752    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790755    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790758    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790762    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790765    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790768    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790771    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790774    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790778    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790782    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790798    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790801    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790804    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790807    2575 flags.go:64] FLAG: --enable-server="true"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790811    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790815    2575 flags.go:64] FLAG: --event-burst="100"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790818    2575 flags.go:64] FLAG: --event-qps="50"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790821    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790824    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790827    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790830    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790833    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790836    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790839    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 27 20:57:34.796531 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790842    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790844    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790847    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790850    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790853    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790856    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790859    2575 flags.go:64] FLAG: --feature-gates=""
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790863    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790866    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790869    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790872    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790875    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790878    2575 flags.go:64] FLAG: --help="false"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790881    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-131-197.ec2.internal"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790884    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790887    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790890    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790894    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790898    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790901    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790903    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790906    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790909    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 20:57:34.797403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790912    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790915    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790918    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790920    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790923    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790926    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790929    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790932    2575 flags.go:64] FLAG: --lock-file=""
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790934    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790937    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790940    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790945    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790948    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790952    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790955    2575 flags.go:64] FLAG: --logging-format="text"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790958    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790962    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790965    2575 flags.go:64] FLAG: --manifest-url=""
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790968    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790972    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790976    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790981    2575 flags.go:64] FLAG: --max-pods="110"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790984    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790987    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790990    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 20:57:34.798394 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790993    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790996    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.790999    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791003    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791011    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791014    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791017    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791020    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791023    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791028    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791031    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791034    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791037    2575 flags.go:64] FLAG: --port="10250"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791039    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791042    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0853b5879b69519a0"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791045    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791048    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791051    2575 flags.go:64] FLAG: --register-node="true"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791053    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791057    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791062    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791065    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791068    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791071    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791074    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 20:57:34.799391 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791078    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791081    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791084    2575 flags.go:64] FLAG: --runonce="false"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791087    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791090    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791093    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791096    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791099    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791102    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791105    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791108    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791112    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791114    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791117    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791120    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791123    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791126    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791128    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791133    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791136    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791139    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791143    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791146    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791149    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791151    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 20:57:34.800364 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791154    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791157    2575 flags.go:64] FLAG: --v="2"
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791163    2575 flags.go:64] FLAG: --version="false"
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791167    2575 flags.go:64] FLAG: --vmodule=""
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791170    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.791174    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791293    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791299    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791303    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791306    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791309    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791312    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791315    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791318    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791321    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791323    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791326    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791329    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791332    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791334    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:34.801421 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791337    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791339    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791342    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791344    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791347    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791350    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791352    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791354    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791357    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791359    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791362    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791365    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791367    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791370    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791373    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791376    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791379    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791381    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791383    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791387    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:34.802368 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791390    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791392    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791395    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791398    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791400    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791403    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791406    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791408    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791411    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791414    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791416    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791420    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791423    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791425    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791428    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791430    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791432    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791435    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791439    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791442    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:34.803273 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791445    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791447    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791450    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791454    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791457    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791460    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791464    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791467    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791470    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791473    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791476    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791479    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791482    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791485    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791487    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791490    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791492    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791495    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791498    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:34.803989 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791500    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791503    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791505    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791508    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791510    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791513    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791516    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791519    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791521    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791524    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791526    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791529    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791532    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791534    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791537    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791540    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791543    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791545    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791548    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791552    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:34.804777 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791554    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791557    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791559    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791562    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791566    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.791568    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.792027    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.801461    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.801486    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.801513    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.801522    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801610    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801618    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801625    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:34.805427 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801632    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801637    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801642    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801646    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801651    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801655    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801660    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801664    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801669    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801674    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801680    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801685    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801690    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801694    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801698    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801702    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801707    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801711    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801716    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801720    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:34.805913 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801725    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801730    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801734    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801740    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801745    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801749    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801753    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801758    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801762    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801767    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801772    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801778    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801804    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801809    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801814    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801818    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801822    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801826    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801830    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801834    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:34.806428 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801839    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801843    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801847    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801863    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801869    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801874    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801879    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801883    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801887    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801891    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801896    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801900    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801905    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801909    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801914    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801918    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801923    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801927    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801931    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801935    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:34.807039 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801940    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801947    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801953    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801957    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801962    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801967    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801972    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801976    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801981    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801984    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801989    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801993    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.801997    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802002    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802007    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802011    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802023    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802027    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802031    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:34.807585 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802036    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802040    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802045    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802050    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802054    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802058    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802062    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802067    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802071    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802076    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802081    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802085    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802089    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802094    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802098    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802102    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:34.808079 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802106    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.802115    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802300    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802308    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802314    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802319    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802323    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802327    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802332    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802340    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802346    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802351    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802355    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802360    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802372    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 20:57:34.808532 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802377    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802381    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802385    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802389    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802394    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802398    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802402    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802406    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802410    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802415    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802420    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802424    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802428    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802433    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802437    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802441    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802445    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802449    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802454    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 20:57:34.808946 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802458    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802462    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802467    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802471    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802475    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802479    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802483    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802487    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802492    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802496    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802500    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802504    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802509    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802515    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802520    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802524    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802528    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802532    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802539    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802544    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 20:57:34.809443 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802549    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802554    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802559    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802564    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802568    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802572    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802576    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802581    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802585    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802589    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802594    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802598    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802604    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802609    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802613    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802617    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802622    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802626    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802631    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802635    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 20:57:34.810091 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802639    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802643    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802647    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802652    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802656    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802660    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802665    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802670    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802674    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802678    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802683    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802687    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802691    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802695    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802699    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802703    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802708    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802713    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802717    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802721    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 20:57:34.810902 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802725    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802730    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802734    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802738    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802742    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802746    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:34.802750    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.802759    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.802976    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.805632    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.807185    2575 server.go:1019] "Starting client certificate rotation"
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.807296    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.807362    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 20:57:34.811730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.810358    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:57:34.812294 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.812215    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 20:57:34.824371 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.824349    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 27 20:57:34.826492 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.826477    2575 log.go:25] "Validated CRI v1 image API"
Jul 27 20:57:34.827326 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.827312    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 20:57:34.829560 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.829541    2575 fs.go:135] Filesystem UUIDs: map[0e6b6e7c-bc27-4562-a6d4-42234dde9419:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f478fc67-47d1-4bad-9fc6-6e38ed55124d:/dev/nvme0n1p3]
Jul 27 20:57:34.829609 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.829561    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 20:57:34.836305 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.836183    2575 manager.go:216] Machine: {Timestamp:2026-07-27 20:57:34.835051805 +0000 UTC m=+0.309189615 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099841 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4c98e67d12c236964b42dcbc2298 SystemUUID:ec2a4c98-e67d-12c2-3696-4b42dcbc2298 BootID:b669dbd9-1756-4c04-b034-12103212cc72 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d7:2f:31:13:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d7:2f:31:13:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:97:89:a7:19:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 20:57:34.836305 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.836292    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 20:57:34.836458 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.836377    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 20:57:34.836580 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.836562    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:57:34.837251 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.837222    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 20:57:34.837384 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.837254    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 20:57:34.838443 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.838431    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 20:57:34.838483 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.838446    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 20:57:34.838483 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.838454    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:57:34.839076 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.839066    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 20:57:34.839730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.839720    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 20:57:34.842372 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842361    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:57:34.842492 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842482    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 20:57:34.842532 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842511    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 20:57:34.842532 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842521    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 20:57:34.842532 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842531    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 20:57:34.842644 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842540    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 27 20:57:34.842644 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842548    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 20:57:34.842934 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842907    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:57:34.842934 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.842934    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 20:57:34.845093 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.845073    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 20:57:34.846962 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.846948    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 20:57:34.847024 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.846979    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 20:57:34.848506 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848494    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 20:57:34.848543 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848510    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 20:57:34.848543 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848518    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 20:57:34.848543 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848524    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 20:57:34.848543 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848533    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 20:57:34.848543 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848539    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 20:57:34.848676 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848546    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 20:57:34.848676 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848552    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 20:57:34.848676 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848559    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 20:57:34.848676 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848565    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 20:57:34.848676 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848573    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 20:57:34.848676 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.848578    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 20:57:34.850111 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.850095    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 20:57:34.850111 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.850112    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 20:57:34.851625 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.851603    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 20:57:34.851680 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.851642    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 20:57:34.853760 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.853746    2575 server.go:1268] "Started kubelet"
Jul 27 20:57:34.853855 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.853822    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 20:57:34.853909 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.853848    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 20:57:34.853973 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.853946    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 20:57:34.855029 ip-10-0-131-197 systemd[1]: Started Kubernetes Kubelet.
Jul 27 20:57:34.855482 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.855380    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 20:57:34.856123 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.856109    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 20:57:34.858253 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.858237    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 20:57:34.860098 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.860080    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 20:57:34.862061 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.861159    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-197.ec2.internal.18c64113a09ba24b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-197.ec2.internal,UID:ip-10-0-131-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-197.ec2.internal,},FirstTimestamp:2026-07-27 20:57:34.853718603 +0000 UTC m=+0.327856413,LastTimestamp:2026-07-27 20:57:34.853718603 +0000 UTC m=+0.327856413,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-197.ec2.internal,}"
Jul 27 20:57:34.864572 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.864555    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 20:57:34.865190 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.865169    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 20:57:34.865416 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.865397    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:34.865908 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.865892    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 20:57:34.866011 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.865994    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 20:57:34.866114 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.865893    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 20:57:34.866168 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866120    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 20:57:34.866168 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866127    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 20:57:34.866168 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866142    2575 factory.go:55] Registering systemd factory
Jul 27 20:57:34.866168 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866159    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 27 20:57:34.866607 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866591    2575 factory.go:153] Registering CRI-O factory
Jul 27 20:57:34.866673 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866611    2575 factory.go:223] Registration of the crio container factory successfully
Jul 27 20:57:34.866673 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866664    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 20:57:34.866745 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866688    2575 factory.go:103] Registering Raw factory
Jul 27 20:57:34.866745 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.866704    2575 manager.go:1196] Started watching for new ooms in manager
Jul 27 20:57:34.867395 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.867378    2575 manager.go:349] Starting recovery of all containers
Jul 27 20:57:34.867550 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.867525    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 20:57:34.867622 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.867541    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 20:57:34.868999 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.868973    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z9g68"
Jul 27 20:57:34.874139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.874115    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z9g68"
Jul 27 20:57:34.876340 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.876294    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 20:57:34.881268 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.881084    2575 manager.go:354] Recovery completed
Jul 27 20:57:34.885694 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.885682    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:34.887654 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.887632    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:34.887738 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.887671    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:34.887738 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.887683    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:34.888276 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.888262    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 20:57:34.888276 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.888269    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:34.888276 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.888273    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 20:57:34.888420 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.888288    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 20:57:34.889057 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.889041    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:34.889306 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.889068    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:34.889306 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.889078    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:34.889981 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.889906    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-197.ec2.internal.18c64113a2a172ae  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-197.ec2.internal,UID:ip-10-0-131-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-197.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-197.ec2.internal,},FirstTimestamp:2026-07-27 20:57:34.887654062 +0000 UTC m=+0.361791879,LastTimestamp:2026-07-27 20:57:34.887654062 +0000 UTC m=+0.361791879,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-197.ec2.internal,}"
Jul 27 20:57:34.890730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.890713    2575 policy_none.go:49] "None policy: Start"
Jul 27 20:57:34.890730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.890729    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 20:57:34.890900 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.890740    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 20:57:34.892699 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.892687    2575 policy_none.go:47] "Start"
Jul 27 20:57:34.923337 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.923322    2575 manager.go:337] "Starting Device Plugin manager"
Jul 27 20:57:34.923417 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.923368    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 20:57:34.923417 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.923382    2575 server.go:87] "Starting device plugin registration server"
Jul 27 20:57:34.923654 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.923640    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 20:57:34.923709 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.923655    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 20:57:34.923767 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.923753    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 20:57:34.923855 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.923842    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 20:57:34.923934 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:34.923857    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 20:57:34.924358 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.924336    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 20:57:34.924430 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:34.924397    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.024038 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.024007    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:35.026108 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.025082    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:35.026108 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.025110    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:35.026108 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.025120    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:35.026108 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.025145    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.033639 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.033586    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.033639 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.033613    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-197.ec2.internal\": node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.047863 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.047835    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.062509 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.062488    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 20:57:35.062621 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.062529    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 20:57:35.062621 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.062552    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 20:57:35.062621 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.062586    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 20:57:35.065327 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.065310    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:35.148275 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.148234    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.163423 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.163390    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal"]
Jul 27 20:57:35.163526 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.163505    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:35.166194 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.166175    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:35.166283 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.166210    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:35.166283 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.166226    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:35.166573 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.166558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/55d60eb28e9cbf8a81af3c88a805f4cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"55d60eb28e9cbf8a81af3c88a805f4cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.166607 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.166582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55d60eb28e9cbf8a81af3c88a805f4cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"55d60eb28e9cbf8a81af3c88a805f4cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.168564 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.168552    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:35.169166 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.169020    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.169166 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.169076    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:35.170962 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.170940    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:35.171079 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.170974    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:35.171079 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.170988    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:35.171079 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.170997    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:35.171079 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.171025    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:35.171079 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.171041    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:35.173262 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.173245    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.173350 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.173276    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 20:57:35.177850 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.177832    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 20:57:35.177934 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.177860    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 20:57:35.177934 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.177870    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeHasSufficientPID"
Jul 27 20:57:35.189403 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.189380    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-197.ec2.internal\" not found" node="ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.195134 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.195115    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-197.ec2.internal\" not found" node="ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.248646 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.248615    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.266837 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.266813    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/55d60eb28e9cbf8a81af3c88a805f4cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"55d60eb28e9cbf8a81af3c88a805f4cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.266837 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.266847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55d60eb28e9cbf8a81af3c88a805f4cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"55d60eb28e9cbf8a81af3c88a805f4cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.267073 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.266899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55d60eb28e9cbf8a81af3c88a805f4cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"55d60eb28e9cbf8a81af3c88a805f4cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.267073 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.266900    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/55d60eb28e9cbf8a81af3c88a805f4cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal\" (UID: \"55d60eb28e9cbf8a81af3c88a805f4cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.349189 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.349106    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.367390 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.367362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/856f9094e8566cc5118fb2e7ae028257-config\") pod \"kube-apiserver-proxy-ip-10-0-131-197.ec2.internal\" (UID: \"856f9094e8566cc5118fb2e7ae028257\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.449553 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.449514    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.467857 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.467834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/856f9094e8566cc5118fb2e7ae028257-config\") pod \"kube-apiserver-proxy-ip-10-0-131-197.ec2.internal\" (UID: \"856f9094e8566cc5118fb2e7ae028257\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.467927 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.467883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/856f9094e8566cc5118fb2e7ae028257-config\") pod \"kube-apiserver-proxy-ip-10-0-131-197.ec2.internal\" (UID: \"856f9094e8566cc5118fb2e7ae028257\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.492034 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.492005    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.497738 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.497718    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:35.549641 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.549597    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.650186 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.650119    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.750611 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.750579    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.806152 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.806117    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 20:57:35.806628 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.806270    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 20:57:35.851572 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:35.851543    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:35.880440 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.880406    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:52:36 +0000 UTC" deadline="2028-01-15 17:15:07.824329996 +0000 UTC"
Jul 27 20:57:35.880440 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:35.880433    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12884h17m31.943899944s"
Jul 27 20:57:37.160116 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:37.160091    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:37.253881 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:37.253850    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856f9094e8566cc5118fb2e7ae028257.slice/crio-41e197ca6cb20923abd10760ea82e9b9d06934d6a4730a88c2f16dc6d5398344 WatchSource:0}: Error finding container 41e197ca6cb20923abd10760ea82e9b9d06934d6a4730a88c2f16dc6d5398344: Status 404 returned error can't find the container with id 41e197ca6cb20923abd10760ea82e9b9d06934d6a4730a88c2f16dc6d5398344
Jul 27 20:57:37.254171 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:37.254150    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d60eb28e9cbf8a81af3c88a805f4cd.slice/crio-20e0b0a5ecbe51f7fa146560909acd7c2d422bac7766500cc6da142ff7569d82 WatchSource:0}: Error finding container 20e0b0a5ecbe51f7fa146560909acd7c2d422bac7766500cc6da142ff7569d82: Status 404 returned error can't find the container with id 20e0b0a5ecbe51f7fa146560909acd7c2d422bac7766500cc6da142ff7569d82
Jul 27 20:57:37.259850 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.259830    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:57:37.260175 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:37.260153    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:37.274445 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.274407    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" event={"ID":"55d60eb28e9cbf8a81af3c88a805f4cd","Type":"ContainerStarted","Data":"20e0b0a5ecbe51f7fa146560909acd7c2d422bac7766500cc6da142ff7569d82"}
Jul 27 20:57:37.275517 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.275490    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" event={"ID":"856f9094e8566cc5118fb2e7ae028257","Type":"ContainerStarted","Data":"41e197ca6cb20923abd10760ea82e9b9d06934d6a4730a88c2f16dc6d5398344"}
Jul 27 20:57:37.360877 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:37.360839    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:37.461503 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:37.461425    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:37.545547 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.545517    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:37.561536 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:37.561506    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-197.ec2.internal\" not found"
Jul 27 20:57:37.568962 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.568943    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:37.573870 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.573854    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:37.585165 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.585143    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:57:37.586262 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.586237    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal"
Jul 27 20:57:37.595600 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.595584    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 20:57:37.650951 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:37.650922    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:38.052070 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.052034    2575 apiserver.go:52] "Watching apiserver"
Jul 27 20:57:38.058440 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.058418    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 20:57:38.060456 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.060422    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-2f6dc","kube-system/global-pull-secret-syncer-825k6","kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd","openshift-multus/multus-additional-cni-plugins-gvq9q","openshift-multus/network-metrics-daemon-mqsw2","openshift-network-diagnostics/network-check-target-t55cm","openshift-ovn-kubernetes/ovnkube-node-zhxxh","kube-system/konnectivity-agent-k2nhq","openshift-cluster-node-tuning-operator/tuned-5ncz7","openshift-dns/node-resolver-vwt8s","openshift-image-registry/node-ca-v7f7j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal","openshift-multus/multus-8zdsh"]
Jul 27 20:57:38.063403 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.063054    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:38.063403 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.063130    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:38.065605 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.065240    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.067482 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.067455    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 20:57:38.067655 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.067629    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 20:57:38.067838 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.067823    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g4dd7\""
Jul 27 20:57:38.068005 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.067988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.070481 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.069577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.070832 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.070811    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 20:57:38.071371 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.071350    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 20:57:38.071806 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.071768    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j6nrj\""
Jul 27 20:57:38.071946 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.071919    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.072254 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.072229    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 20:57:38.072530 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.072514    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 20:57:38.073872 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.073851    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 20:57:38.074268 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.074251    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 20:57:38.074513 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.074498    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9cjdn\""
Jul 27 20:57:38.074712 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.074698    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 20:57:38.077348 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.075247    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 20:57:38.077348 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.075572    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 20:57:38.077348 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.075829    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2jnv\""
Jul 27 20:57:38.077348 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.076172    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 20:57:38.077348 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.076384    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:38.077348 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.076456    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:38.077826 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.077798    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:57:38.079974 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.079956    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tlv5l\""
Jul 27 20:57:38.080325 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.080307    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 20:57:38.080672 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.080579    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 20:57:38.081000 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.080980    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.083032 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.083178 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:38.083178 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-hosts-file\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.083178 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-conf-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.083178 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-etc-kubernetes\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-registration-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-device-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xr2\" (UniqueName: \"kubernetes.io/projected/78a266dc-b8d5-4588-a448-2140db6bf281-kube-api-access-x6xr2\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083284    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-cni-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-socket-dir-parent\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-kubelet\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.083426 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542936d6-7cd3-409b-b312-7d318043f522-multus-daemon-config\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083501    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cnibin\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8b44\" (UniqueName: \"kubernetes.io/projected/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-kube-api-access-f8b44\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-socket-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-os-release\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083658    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkcn5\""
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h49jn\" (UniqueName: \"kubernetes.io/projected/2ee7da33-7e2e-4467-b6d6-54f885d4d067-kube-api-access-h49jn\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-multus-certs\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-sys-fs\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083826    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-tmp-dir\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-hostroot\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.083896 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl6jt\" (UniqueName: \"kubernetes.io/projected/542936d6-7cd3-409b-b312-7d318043f522-kube-api-access-cl6jt\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-system-cni-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-netns\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.083979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-k8s-cni-cncf-io\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-cni-bin\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-cni-multus\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-system-cni-dir\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hqqj\" (UniqueName: \"kubernetes.io/projected/5c7f9a86-bdee-4f19-b74a-898fe54df0df-kube-api-access-5hqqj\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-cnibin\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084116    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-os-release\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084171    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542936d6-7cd3-409b-b312-7d318043f522-cni-binary-copy\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084394    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084453    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.084510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.084633 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.084561    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:38.085653 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.085636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.087653 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.087633    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:57:38.087843 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.087826    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f7jsp\""
Jul 27 20:57:38.087921 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.087877    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 20:57:38.088528 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.088107    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.088817 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.088800    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 20:57:38.090883 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.090556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.090883 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.090576    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 20:57:38.090883 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.090700    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 20:57:38.090883 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.090763    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 20:57:38.091111 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.091000    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xnc99\""
Jul 27 20:57:38.092698 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.092683    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rv7sd\""
Jul 27 20:57:38.092882 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.092864    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 20:57:38.093284 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.093256    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 20:57:38.093385 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.093289    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 20:57:38.111341 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.111322    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-65bkv"
Jul 27 20:57:38.123592 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.123518    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-65bkv"
Jul 27 20:57:38.175761 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.175741    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 20:57:38.185005 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.184976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15c13300-9c10-484f-b56e-e99e18d3d4d8-host\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.185005 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185005    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f6948c8-6610-4973-8b75-9ee5f48f8c46-dbus\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.185131 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mwxp\" (UniqueName: \"kubernetes.io/projected/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-kube-api-access-4mwxp\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.185131 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:38.185131 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.185307 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185138    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.185307 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.185185    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:38.185307 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-slash\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.185307 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-node-log\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.185307 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.185262    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:38.685246375 +0000 UTC m=+2.950960470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:38.185307 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-env-overrides\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.185546 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-kubernetes\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.185546 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-systemd\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.185546 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhr9b\" (UniqueName: \"kubernetes.io/projected/ced64dd4-272a-46b6-b368-c9da7c343176-kube-api-access-hhr9b\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.187359 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.185389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysctl-d\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.187445 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-iptables-alerter-script\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.187445 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.187579 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-multus-certs\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.187579 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-modprobe-d\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.187579 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187523    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-multus-certs\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.187579 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f6948c8-6610-4973-8b75-9ee5f48f8c46-kubelet-config\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.187762 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-host-slash\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.187762 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.187762 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-tmp-dir\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.187762 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-hostroot\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.187762 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl6jt\" (UniqueName: \"kubernetes.io/projected/542936d6-7cd3-409b-b312-7d318043f522-kube-api-access-cl6jt\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188001 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187787    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-systemd\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188001 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysconfig\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.188001 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187841    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysctl-conf\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.188001 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-var-lib-kubelet\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.188001 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-system-cni-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188001 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-netns\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188001 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-run-ovn-kubernetes\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188001 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.187990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-cni-netd\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shj2q\" (UniqueName: \"kubernetes.io/projected/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-kube-api-access-shj2q\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188048    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15c13300-9c10-484f-b56e-e99e18d3d4d8-serviceca\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.188375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188058    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.188375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-log-socket\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-cni-multus\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-os-release\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542936d6-7cd3-409b-b312-7d318043f522-cni-binary-copy\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188332    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-os-release\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188608 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188398    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-system-cni-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188608 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-netns\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.188608 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw55n\" (UniqueName: \"kubernetes.io/projected/15c13300-9c10-484f-b56e-e99e18d3d4d8-kube-api-access-lw55n\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.188608 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.188608 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.188744 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.188744 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188800 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xr2\" (UniqueName: \"kubernetes.io/projected/78a266dc-b8d5-4588-a448-2140db6bf281-kube-api-access-x6xr2\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.188800 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-run-netns\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188857 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-cni-bin\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188857 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.188916 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.188916 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-cni-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.189049 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.188996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-socket-dir-parent\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.189147 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.189108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542936d6-7cd3-409b-b312-7d318043f522-cni-binary-copy\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.189652 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.189537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-cni-multus\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.189652 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.189598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-kubelet\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.189792 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.189752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-hostroot\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.190075 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.189964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542936d6-7cd3-409b-b312-7d318043f522-multus-daemon-config\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.190075 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.189987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-cni-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.190075 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.189963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-etc-selinux\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.190075 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovn-node-metrics-cert\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.190075 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190017    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-socket-dir-parent\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.190075 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-tmp-dir\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.190420 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced64dd4-272a-46b6-b368-c9da7c343176-tmp\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.190420 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-kubelet\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.190420 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190181    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cnibin\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.190420 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.190420 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190253    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cnibin\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.190420 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8b44\" (UniqueName: \"kubernetes.io/projected/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-kube-api-access-f8b44\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.190420 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-socket-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.190741 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-systemd-units\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.190741 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542936d6-7cd3-409b-b312-7d318043f522-multus-daemon-config\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.190741 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-sys\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.190741 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-socket-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.190741 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02bb7ea9-f174-4266-9914-9af66fa50ff4-agent-certs\") pod \"konnectivity-agent-k2nhq\" (UID: \"02bb7ea9-f174-4266-9914-9af66fa50ff4\") " pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:57:38.190741 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-os-release\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.190741 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h49jn\" (UniqueName: \"kubernetes.io/projected/2ee7da33-7e2e-4467-b6d6-54f885d4d067-kube-api-access-h49jn\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:38.191011 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-os-release\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.191011 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-sys-fs\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.191011 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-etc-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.191011 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovnkube-script-lib\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.191011 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.191011 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-sys-fs\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.191011 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.190963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02bb7ea9-f174-4266-9914-9af66fa50ff4-konnectivity-ca\") pod \"konnectivity-agent-k2nhq\" (UID: \"02bb7ea9-f174-4266-9914-9af66fa50ff4\") " pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:57:38.191331 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-kubelet\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.191331 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-ovn\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.191331 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-k8s-cni-cncf-io\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191331 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-cni-bin\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191331 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-system-cni-dir\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.191331 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hqqj\" (UniqueName: \"kubernetes.io/projected/5c7f9a86-bdee-4f19-b74a-898fe54df0df-kube-api-access-5hqqj\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.191331 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-cnibin\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191331 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191321    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-var-lib-cni-bin\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191370    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c7f9a86-bdee-4f19-b74a-898fe54df0df-system-cni-dir\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-cnibin\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-conf-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-etc-kubernetes\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-host-run-k8s-cni-cncf-io\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-etc-kubernetes\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-registration-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191517    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542936d6-7cd3-409b-b312-7d318043f522-multus-conf-dir\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191522    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-hosts-file\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-device-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-var-lib-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.191630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovnkube-config\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.192139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-registration-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.192139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191666    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-lib-modules\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.192139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191669    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c7f9a86-bdee-4f19-b74a-898fe54df0df-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.192139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-host\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.192139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-hosts-file\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.192139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ced64dd4-272a-46b6-b368-c9da7c343176-etc-tuned\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.192139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78a266dc-b8d5-4588-a448-2140db6bf281-device-dir\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.192139 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.191832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-run\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.193670 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.193651    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 20:57:38.197317 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.197298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl6jt\" (UniqueName: \"kubernetes.io/projected/542936d6-7cd3-409b-b312-7d318043f522-kube-api-access-cl6jt\") pod \"multus-8zdsh\" (UID: \"542936d6-7cd3-409b-b312-7d318043f522\") " pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.197409 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.197298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xr2\" (UniqueName: \"kubernetes.io/projected/78a266dc-b8d5-4588-a448-2140db6bf281-kube-api-access-x6xr2\") pod \"aws-ebs-csi-driver-node-bmdgd\" (UID: \"78a266dc-b8d5-4588-a448-2140db6bf281\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.199262 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.199242    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:38.199262 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.199265    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:38.199387 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.199279    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4cx8z for pod openshift-network-diagnostics/network-check-target-t55cm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:38.199387 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.199342    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z podName:34a54b10-f42f-49c8-93f3-7b489ec42f85 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:38.699324134 +0000 UTC m=+2.965038247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx8z" (UniqueName: "kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z") pod "network-check-target-t55cm" (UID: "34a54b10-f42f-49c8-93f3-7b489ec42f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:38.200095 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.200075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8b44\" (UniqueName: \"kubernetes.io/projected/6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260-kube-api-access-f8b44\") pod \"node-resolver-vwt8s\" (UID: \"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260\") " pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.202229 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.202183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hqqj\" (UniqueName: \"kubernetes.io/projected/5c7f9a86-bdee-4f19-b74a-898fe54df0df-kube-api-access-5hqqj\") pod \"multus-additional-cni-plugins-gvq9q\" (UID: \"5c7f9a86-bdee-4f19-b74a-898fe54df0df\") " pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.202414 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.202382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h49jn\" (UniqueName: \"kubernetes.io/projected/2ee7da33-7e2e-4467-b6d6-54f885d4d067-kube-api-access-h49jn\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:38.292062 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02bb7ea9-f174-4266-9914-9af66fa50ff4-agent-certs\") pod \"konnectivity-agent-k2nhq\" (UID: \"02bb7ea9-f174-4266-9914-9af66fa50ff4\") " pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:57:38.292225 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-etc-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292225 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovnkube-script-lib\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292225 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02bb7ea9-f174-4266-9914-9af66fa50ff4-konnectivity-ca\") pod \"konnectivity-agent-k2nhq\" (UID: \"02bb7ea9-f174-4266-9914-9af66fa50ff4\") " pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:57:38.292225 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-etc-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292459 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-kubelet\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292459 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-ovn\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292459 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-var-lib-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292459 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovnkube-config\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292459 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-lib-modules\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.292459 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-host\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.292459 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ced64dd4-272a-46b6-b368-c9da7c343176-etc-tuned\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-var-lib-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-run\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15c13300-9c10-484f-b56e-e99e18d3d4d8-host\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f6948c8-6610-4973-8b75-9ee5f48f8c46-dbus\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mwxp\" (UniqueName: \"kubernetes.io/projected/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-kube-api-access-4mwxp\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-slash\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-node-log\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-env-overrides\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-kubernetes\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-systemd\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhr9b\" (UniqueName: \"kubernetes.io/projected/ced64dd4-272a-46b6-b368-c9da7c343176-kube-api-access-hhr9b\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292683    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02bb7ea9-f174-4266-9914-9af66fa50ff4-konnectivity-ca\") pod \"konnectivity-agent-k2nhq\" (UID: \"02bb7ea9-f174-4266-9914-9af66fa50ff4\") " pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysctl-d\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-iptables-alerter-script\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovnkube-script-lib\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292746    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-slash\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292757    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-kubelet\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.292810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-node-log\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292772    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f6948c8-6610-4973-8b75-9ee5f48f8c46-dbus\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-ovn\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292824    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-systemd\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15c13300-9c10-484f-b56e-e99e18d3d4d8-host\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovnkube-config\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-host\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-modprobe-d\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-modprobe-d\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f6948c8-6610-4973-8b75-9ee5f48f8c46-kubelet-config\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.292999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-run\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-host-slash\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293026    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-kubernetes\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293049    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-systemd\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysconfig\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysctl-d\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysctl-conf\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f6948c8-6610-4973-8b75-9ee5f48f8c46-kubelet-config\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.293669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-systemd\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-var-lib-kubelet\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-host-slash\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-run-ovn-kubernetes\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293202    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-run-ovn-kubernetes\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293233    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-cni-netd\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293237    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysctl-conf\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-cni-netd\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-etc-sysconfig\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-lib-modules\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shj2q\" (UniqueName: \"kubernetes.io/projected/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-kube-api-access-shj2q\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293372    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-var-lib-kubelet\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15c13300-9c10-484f-b56e-e99e18d3d4d8-serviceca\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293418    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-log-socket\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw55n\" (UniqueName: \"kubernetes.io/projected/15c13300-9c10-484f-b56e-e99e18d3d4d8-kube-api-access-lw55n\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-log-socket\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.294469 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293545    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-run-openvswitch\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293601    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-run-netns\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-env-overrides\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-cni-bin\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-run-netns\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovn-node-metrics-cert\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293659    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-host-cni-bin\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced64dd4-272a-46b6-b368-c9da7c343176-tmp\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15c13300-9c10-484f-b56e-e99e18d3d4d8-serviceca\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-systemd-units\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.293741    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-sys\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293818    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-systemd-units\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.293835    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret podName:5f6948c8-6610-4973-8b75-9ee5f48f8c46 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:38.7938179 +0000 UTC m=+3.059531996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret") pod "global-pull-secret-syncer-825k6" (UID: "5f6948c8-6610-4973-8b75-9ee5f48f8c46") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:38.295103 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.293852    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ced64dd4-272a-46b6-b368-c9da7c343176-sys\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.295674 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.294155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-iptables-alerter-script\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.295674 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.295465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02bb7ea9-f174-4266-9914-9af66fa50ff4-agent-certs\") pod \"konnectivity-agent-k2nhq\" (UID: \"02bb7ea9-f174-4266-9914-9af66fa50ff4\") " pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:57:38.295975 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.295957    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ced64dd4-272a-46b6-b368-c9da7c343176-etc-tuned\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.296204 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.296180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced64dd4-272a-46b6-b368-c9da7c343176-tmp\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.297559 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.297542    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-ovn-node-metrics-cert\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.327589 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.327531    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shj2q\" (UniqueName: \"kubernetes.io/projected/5856ec0e-fb26-48ce-9a1f-7fb8e0504480-kube-api-access-shj2q\") pod \"ovnkube-node-zhxxh\" (UID: \"5856ec0e-fb26-48ce-9a1f-7fb8e0504480\") " pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.327913 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.327888    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhr9b\" (UniqueName: \"kubernetes.io/projected/ced64dd4-272a-46b6-b368-c9da7c343176-kube-api-access-hhr9b\") pod \"tuned-5ncz7\" (UID: \"ced64dd4-272a-46b6-b368-c9da7c343176\") " pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.328326 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.328304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mwxp\" (UniqueName: \"kubernetes.io/projected/6fb06055-e1b1-41d1-8b71-c2ec4ada6c68-kube-api-access-4mwxp\") pod \"iptables-alerter-2f6dc\" (UID: \"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68\") " pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.328630 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.328609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw55n\" (UniqueName: \"kubernetes.io/projected/15c13300-9c10-484f-b56e-e99e18d3d4d8-kube-api-access-lw55n\") pod \"node-ca-v7f7j\" (UID: \"15c13300-9c10-484f-b56e-e99e18d3d4d8\") " pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.386308 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.386276    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vwt8s"
Jul 27 20:57:38.393800 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.393779    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8zdsh"
Jul 27 20:57:38.409493 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.409473    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd"
Jul 27 20:57:38.414187 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.414163    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvq9q"
Jul 27 20:57:38.419774 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.419756    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:57:38.426436 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.426415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:57:38.431994 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.431979    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5ncz7"
Jul 27 20:57:38.438560 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.438544    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2f6dc"
Jul 27 20:57:38.444980 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.444963    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v7f7j"
Jul 27 20:57:38.480880 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.480853    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 20:57:38.696825 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.696796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:38.696978 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.696957    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:38.697049 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.697036    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:39.697012393 +0000 UTC m=+3.962726489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:38.797129 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.797096    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:38.797305 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:38.797192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:38.797305 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.797302    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:38.797412 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.797320    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:38.797412 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.797329    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4cx8z for pod openshift-network-diagnostics/network-check-target-t55cm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:38.797412 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.797330    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:38.797412 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.797387    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z podName:34a54b10-f42f-49c8-93f3-7b489ec42f85 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:39.797369072 +0000 UTC m=+4.063083189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx8z" (UniqueName: "kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z") pod "network-check-target-t55cm" (UID: "34a54b10-f42f-49c8-93f3-7b489ec42f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:38.797412 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:38.797403    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret podName:5f6948c8-6610-4973-8b75-9ee5f48f8c46 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:39.797396592 +0000 UTC m=+4.063110687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret") pod "global-pull-secret-syncer-825k6" (UID: "5f6948c8-6610-4973-8b75-9ee5f48f8c46") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:39.126376 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.126341    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:52:38 +0000 UTC" deadline="2027-12-26 08:40:29.42218145 +0000 UTC"
Jul 27 20:57:39.126376 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.126375    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12395h42m50.295810758s"
Jul 27 20:57:39.140666 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:39.140642    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd9c93f_c2b8_4b88_8e7f_6cc8f4d96260.slice/crio-3f8ade3a311d0ee18ed18a3768006ca8dd7e3eeed1ec170a9bd092d968656ec3 WatchSource:0}: Error finding container 3f8ade3a311d0ee18ed18a3768006ca8dd7e3eeed1ec170a9bd092d968656ec3: Status 404 returned error can't find the container with id 3f8ade3a311d0ee18ed18a3768006ca8dd7e3eeed1ec170a9bd092d968656ec3
Jul 27 20:57:39.141992 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:39.141967    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7f9a86_bdee_4f19_b74a_898fe54df0df.slice/crio-f1108b9709394929ce2b4a71fc2c8b403238cf8e835cad9c6b37116bb08e209a WatchSource:0}: Error finding container f1108b9709394929ce2b4a71fc2c8b403238cf8e835cad9c6b37116bb08e209a: Status 404 returned error can't find the container with id f1108b9709394929ce2b4a71fc2c8b403238cf8e835cad9c6b37116bb08e209a
Jul 27 20:57:39.144289 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:39.144270    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bb7ea9_f174_4266_9914_9af66fa50ff4.slice/crio-3e1c440b014a459ac105c188b497708504ca4cee6756dcacc4cc1e827ff01bf4 WatchSource:0}: Error finding container 3e1c440b014a459ac105c188b497708504ca4cee6756dcacc4cc1e827ff01bf4: Status 404 returned error can't find the container with id 3e1c440b014a459ac105c188b497708504ca4cee6756dcacc4cc1e827ff01bf4
Jul 27 20:57:39.145262 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:39.145200    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542936d6_7cd3_409b_b312_7d318043f522.slice/crio-c9e31f512c25f3a4cafb694a47752d22bde15fd69b71d483837b73116bcb4623 WatchSource:0}: Error finding container c9e31f512c25f3a4cafb694a47752d22bde15fd69b71d483837b73116bcb4623: Status 404 returned error can't find the container with id c9e31f512c25f3a4cafb694a47752d22bde15fd69b71d483837b73116bcb4623
Jul 27 20:57:39.146741 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:39.146663    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5856ec0e_fb26_48ce_9a1f_7fb8e0504480.slice/crio-4f3d63fb655e1147058a847edcd7262d43cd5b2b4dc778601d5ef096cfe91ff5 WatchSource:0}: Error finding container 4f3d63fb655e1147058a847edcd7262d43cd5b2b4dc778601d5ef096cfe91ff5: Status 404 returned error can't find the container with id 4f3d63fb655e1147058a847edcd7262d43cd5b2b4dc778601d5ef096cfe91ff5
Jul 27 20:57:39.147563 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:39.147429    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c13300_9c10_484f_b56e_e99e18d3d4d8.slice/crio-7b7aaa482faf7b30eb7ee1d38b2badcf9a6a46cd172a1f7fe7c6cf0343317142 WatchSource:0}: Error finding container 7b7aaa482faf7b30eb7ee1d38b2badcf9a6a46cd172a1f7fe7c6cf0343317142: Status 404 returned error can't find the container with id 7b7aaa482faf7b30eb7ee1d38b2badcf9a6a46cd172a1f7fe7c6cf0343317142
Jul 27 20:57:39.149871 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:57:39.149281    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a266dc_b8d5_4588_a448_2140db6bf281.slice/crio-c65465b0d07c57a728eb1c0ad5b84ed941a8c7fbae502d2ada267514ac5d3286 WatchSource:0}: Error finding container c65465b0d07c57a728eb1c0ad5b84ed941a8c7fbae502d2ada267514ac5d3286: Status 404 returned error can't find the container with id c65465b0d07c57a728eb1c0ad5b84ed941a8c7fbae502d2ada267514ac5d3286
Jul 27 20:57:39.272016 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.271849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:39.272138 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.272101    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:39.280279 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.280252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" event={"ID":"856f9094e8566cc5118fb2e7ae028257","Type":"ContainerStarted","Data":"f383095d15f1bfbd149d2c85a15c6f688808b24412dbfd74246634ccfcb65604"}
Jul 27 20:57:39.281430 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.281403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5ncz7" event={"ID":"ced64dd4-272a-46b6-b368-c9da7c343176","Type":"ContainerStarted","Data":"f29886e444e7bfb39de278b09f27e247178497f10e4fcbedb4171abb1cf2e23b"}
Jul 27 20:57:39.282535 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.282511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2f6dc" event={"ID":"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68","Type":"ContainerStarted","Data":"e72d1f98e743a1ae432721fc6304d0d3a3d971ae0a8c781226d7e9e82335f4ba"}
Jul 27 20:57:39.283707 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.283677    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd" event={"ID":"78a266dc-b8d5-4588-a448-2140db6bf281","Type":"ContainerStarted","Data":"c65465b0d07c57a728eb1c0ad5b84ed941a8c7fbae502d2ada267514ac5d3286"}
Jul 27 20:57:39.284864 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.284838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8zdsh" event={"ID":"542936d6-7cd3-409b-b312-7d318043f522","Type":"ContainerStarted","Data":"c9e31f512c25f3a4cafb694a47752d22bde15fd69b71d483837b73116bcb4623"}
Jul 27 20:57:39.285953 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.285929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2nhq" event={"ID":"02bb7ea9-f174-4266-9914-9af66fa50ff4","Type":"ContainerStarted","Data":"3e1c440b014a459ac105c188b497708504ca4cee6756dcacc4cc1e827ff01bf4"}
Jul 27 20:57:39.287002 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.286979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vwt8s" event={"ID":"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260","Type":"ContainerStarted","Data":"3f8ade3a311d0ee18ed18a3768006ca8dd7e3eeed1ec170a9bd092d968656ec3"}
Jul 27 20:57:39.288031 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.288013    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v7f7j" event={"ID":"15c13300-9c10-484f-b56e-e99e18d3d4d8","Type":"ContainerStarted","Data":"7b7aaa482faf7b30eb7ee1d38b2badcf9a6a46cd172a1f7fe7c6cf0343317142"}
Jul 27 20:57:39.289094 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.289059    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"4f3d63fb655e1147058a847edcd7262d43cd5b2b4dc778601d5ef096cfe91ff5"}
Jul 27 20:57:39.290042 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.290025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerStarted","Data":"f1108b9709394929ce2b4a71fc2c8b403238cf8e835cad9c6b37116bb08e209a"}
Jul 27 20:57:39.704178 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.703567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:39.704178 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.703736    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:39.704178 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.703792    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:41.703774515 +0000 UTC m=+5.969488627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:39.804233 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.803904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:39.804233 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:39.803966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:39.804233 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.804033    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:39.804233 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.804104    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret podName:5f6948c8-6610-4973-8b75-9ee5f48f8c46 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:41.804082995 +0000 UTC m=+6.069797114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret") pod "global-pull-secret-syncer-825k6" (UID: "5f6948c8-6610-4973-8b75-9ee5f48f8c46") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:39.804233 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.804112    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:39.804233 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.804129    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:39.804233 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.804141    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4cx8z for pod openshift-network-diagnostics/network-check-target-t55cm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:39.804233 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:39.804187    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z podName:34a54b10-f42f-49c8-93f3-7b489ec42f85 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:41.804173901 +0000 UTC m=+6.069888014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx8z" (UniqueName: "kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z") pod "network-check-target-t55cm" (UID: "34a54b10-f42f-49c8-93f3-7b489ec42f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:40.127410 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:40.127350    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:52:38 +0000 UTC" deadline="2028-03-08 02:11:00.609946562 +0000 UTC"
Jul 27 20:57:40.127410 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:40.127407    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14141h13m20.482543114s"
Jul 27 20:57:40.271450 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:40.271416    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:40.271643 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:40.271570    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:40.272361 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:40.272085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:40.272361 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:40.272309    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:40.306042 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:40.305486    2575 generic.go:356] "Generic (PLEG): container finished" podID="55d60eb28e9cbf8a81af3c88a805f4cd" containerID="e74725f639bdf6fe99d237ea2fabe4ce3adda74ceb5da5ac2d0a7bf8665ebd2b" exitCode=0
Jul 27 20:57:40.306042 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:40.305980    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" event={"ID":"55d60eb28e9cbf8a81af3c88a805f4cd","Type":"ContainerDied","Data":"e74725f639bdf6fe99d237ea2fabe4ce3adda74ceb5da5ac2d0a7bf8665ebd2b"}
Jul 27 20:57:40.322848 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:40.321919    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-197.ec2.internal" podStartSLOduration=3.321901124 podStartE2EDuration="3.321901124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:39.293886671 +0000 UTC m=+3.559600790" watchObservedRunningTime="2026-07-27 20:57:40.321901124 +0000 UTC m=+4.587615245"
Jul 27 20:57:41.272142 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:41.272111    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:41.272622 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.272250    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:41.323069 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:41.322288    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" event={"ID":"55d60eb28e9cbf8a81af3c88a805f4cd","Type":"ContainerStarted","Data":"39bc2b2a0ed37f3c9426a2ac4b5e213129f6365ff1f8c37e3ff24c58c15ee6cd"}
Jul 27 20:57:41.719064 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:41.718809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:41.719064 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.718983    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:41.719064 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.719053    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:45.719035278 +0000 UTC m=+9.984749373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:41.819949 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:41.819892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:41.820132 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:41.819991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:41.820132 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.820126    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:41.820274 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.820200    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret podName:5f6948c8-6610-4973-8b75-9ee5f48f8c46 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:45.820171614 +0000 UTC m=+10.085885730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret") pod "global-pull-secret-syncer-825k6" (UID: "5f6948c8-6610-4973-8b75-9ee5f48f8c46") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:41.820698 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.820672    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:41.820698 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.820698    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:41.820852 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.820711    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4cx8z for pod openshift-network-diagnostics/network-check-target-t55cm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:41.820852 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:41.820771    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z podName:34a54b10-f42f-49c8-93f3-7b489ec42f85 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:45.820745728 +0000 UTC m=+10.086459844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx8z" (UniqueName: "kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z") pod "network-check-target-t55cm" (UID: "34a54b10-f42f-49c8-93f3-7b489ec42f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:42.271404 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:42.271368    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:42.271577 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:42.271511    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:42.271942 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:42.271918    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:42.272084 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:42.272020    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:43.271554 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:43.271523    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:43.272013 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:43.271634    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:44.271810 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:44.271774    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:44.272294 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:44.271906    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:44.272375 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:44.272305    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:44.272454 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:44.272429    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:45.272012 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:45.271977    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:45.272501 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.272133    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:45.754823 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:45.754790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:45.755010 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.754918    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:45.755010 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.754977    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:53.754958572 +0000 UTC m=+18.020672683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:45.855416 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:45.855378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:45.855584 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:45.855460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:45.855584 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.855570    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:45.855689 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.855615    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret podName:5f6948c8-6610-4973-8b75-9ee5f48f8c46 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:53.85560192 +0000 UTC m=+18.121316019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret") pod "global-pull-secret-syncer-825k6" (UID: "5f6948c8-6610-4973-8b75-9ee5f48f8c46") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:45.855955 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.855939    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:45.856013 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.855959    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:45.856013 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.855970    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4cx8z for pod openshift-network-diagnostics/network-check-target-t55cm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:45.856107 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:45.856013    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z podName:34a54b10-f42f-49c8-93f3-7b489ec42f85 nodeName:}" failed. No retries permitted until 2026-07-27 20:57:53.855998102 +0000 UTC m=+18.121712211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx8z" (UniqueName: "kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z") pod "network-check-target-t55cm" (UID: "34a54b10-f42f-49c8-93f3-7b489ec42f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:46.275696 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:46.275670    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:46.276162 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:46.275788    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:46.276259 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:46.276180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:46.276342 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:46.276304    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:47.272129 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:47.272089    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:47.272337 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:47.272281    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:48.271635 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:48.271600    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:48.272082 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:48.271723    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:48.272082 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:48.271781    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:48.272082 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:48.271879    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:49.271550 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:49.271519    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:49.271743 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:49.271648    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:50.271941 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:50.271900    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:50.271941 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:50.271923    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:50.272515 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:50.272063    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:50.272515 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:50.272183    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:51.271819 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:51.271783    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:51.272022 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:51.271927    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:52.272018 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:52.271983    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:52.272490 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:52.272101    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:52.272490 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:52.272141    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:52.272490 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:52.272242    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:53.271561 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:53.271525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:53.271820 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.271655    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:53.820679 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:53.820651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:53.821065 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.820751    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:53.821065 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.820799    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:09.820784943 +0000 UTC m=+34.086499038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:57:53.921355 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:53.921327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:53.921486 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:53.921394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:53.921525 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.921483    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:53.921525 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.921486    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:57:53.921525 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.921507    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:57:53.921525 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.921519    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4cx8z for pod openshift-network-diagnostics/network-check-target-t55cm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:53.921641 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.921542    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret podName:5f6948c8-6610-4973-8b75-9ee5f48f8c46 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:09.92152538 +0000 UTC m=+34.187239491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret") pod "global-pull-secret-syncer-825k6" (UID: "5f6948c8-6610-4973-8b75-9ee5f48f8c46") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:57:53.921641 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:53.921558    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z podName:34a54b10-f42f-49c8-93f3-7b489ec42f85 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:09.921549123 +0000 UTC m=+34.187263236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx8z" (UniqueName: "kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z") pod "network-check-target-t55cm" (UID: "34a54b10-f42f-49c8-93f3-7b489ec42f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:57:54.272078 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:54.272041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:54.272261 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:54.272041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:54.272261 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:54.272188    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:54.272390 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:54.272289    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:55.271986 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:55.271947    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:55.272401 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:55.272054    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:56.272529 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:56.272491    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:56.272964 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:56.272625    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:56.272964 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:56.272697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:56.272964 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:56.272804    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:57.272128 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:57.272096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:57.272314 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:57.272231    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:58.271851 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:58.271826    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:57:58.272185 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:58.271853    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:57:58.272449 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:58.272421    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:57:58.272628 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:58.272613    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:57:58.371696 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:58.371481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd" event={"ID":"78a266dc-b8d5-4588-a448-2140db6bf281","Type":"ContainerStarted","Data":"4536520d9d3d1e7dfda18febfe08dd1b2d238cab009266bec090d16f925596f0"}
Jul 27 20:57:58.382046 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:58.381781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2nhq" event={"ID":"02bb7ea9-f174-4266-9914-9af66fa50ff4","Type":"ContainerStarted","Data":"c117a46406bbbbb64a350622ea11739faa8439ca5fc3adb0fd13a32aa5c87a47"}
Jul 27 20:57:58.399883 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:58.398700    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k2nhq" podStartSLOduration=3.446316876 podStartE2EDuration="22.398657046s" totalImagesPullingTime="18.95234017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:58.398540755 +0000 UTC m=+22.664254873" watchObservedRunningTime="2026-07-27 20:57:58.398657046 +0000 UTC m=+22.664371165"
Jul 27 20:57:58.399883 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:58.399071    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-197.ec2.internal" podStartSLOduration=21.399056281 podStartE2EDuration="21.399056281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:41.338260872 +0000 UTC m=+5.603974993" watchObservedRunningTime="2026-07-27 20:57:58.399056281 +0000 UTC m=+22.664770400"
Jul 27 20:57:59.271969 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.271776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:57:59.272564 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:57:59.272056    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:57:59.385522 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.385493    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c7f9a86-bdee-4f19-b74a-898fe54df0df" containerID="05431f83badef98b74e1b2ec53401ada5d5cda34afad1f01b7c68c66c7d2f02b" exitCode=0
Jul 27 20:57:59.385684 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.385579    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerDied","Data":"05431f83badef98b74e1b2ec53401ada5d5cda34afad1f01b7c68c66c7d2f02b"}
Jul 27 20:57:59.387000 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.386981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5ncz7" event={"ID":"ced64dd4-272a-46b6-b368-c9da7c343176","Type":"ContainerStarted","Data":"521dac76a10fee0d1f1b7f58234c33c0f6548f95c6eb5121f30764a1e6ecfe4a"}
Jul 27 20:57:59.388395 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.388363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8zdsh" event={"ID":"542936d6-7cd3-409b-b312-7d318043f522","Type":"ContainerStarted","Data":"771dcb1e1448267f3b9479155d4b713667976ef8c1b4b7e01acf92b81bf9e836"}
Jul 27 20:57:59.389742 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.389723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vwt8s" event={"ID":"6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260","Type":"ContainerStarted","Data":"a03750ae1e81decdc832d50ef96029ecb955bc9d708cb9823da9bb273054245c"}
Jul 27 20:57:59.393829 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.393801    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v7f7j" event={"ID":"15c13300-9c10-484f-b56e-e99e18d3d4d8","Type":"ContainerStarted","Data":"84b6e5f006c14f72228fddba2c93d008ce6638f9e10c5676da0e1d59e6712cc6"}
Jul 27 20:57:59.396540 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.396521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"34d01cbc0fdaf1800b8a4557d2cd6ebbf25585d18d7f7920cfc0d1bf55a8a2ba"}
Jul 27 20:57:59.396623 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.396572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"7ed10b5237b2cce31a89139df7eb2f4a550c61f3a47b2872cf589c0abdb29bee"}
Jul 27 20:57:59.396623 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.396605    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"637ae621a32e7cb304554a30e38dd20bca9dd9950e5da35b90524b27991b700c"}
Jul 27 20:57:59.396699 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.396638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"c001dc85267c23c73eb6574ae860ccc486071806a5d8f0777a0960e50245cdab"}
Jul 27 20:57:59.396699 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.396666    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"8ac36745acdd11eba843946077044054cf022d8789dbce679fd39a65b7e97a6b"}
Jul 27 20:57:59.396699 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.396694    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"722a16f854a8e3661f413d1b79cf97ad3a50511962efba5957b2c79263359809"}
Jul 27 20:57:59.417664 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.417546    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vwt8s" podStartSLOduration=4.383468106 podStartE2EDuration="23.417534555s" totalImagesPullingTime="19.034066449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:59.41682634 +0000 UTC m=+23.682540457" watchObservedRunningTime="2026-07-27 20:57:59.417534555 +0000 UTC m=+23.683248672"
Jul 27 20:57:59.434562 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.434524    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5ncz7" podStartSLOduration=4.412261999 podStartE2EDuration="23.434511492s" totalImagesPullingTime="19.022249493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:59.433987393 +0000 UTC m=+23.699701511" watchObservedRunningTime="2026-07-27 20:57:59.434511492 +0000 UTC m=+23.700225609"
Jul 27 20:57:59.446844 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.446812    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v7f7j" podStartSLOduration=4.419826885 podStartE2EDuration="23.446799223s" totalImagesPullingTime="19.026972338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:59.446284928 +0000 UTC m=+23.711999047" watchObservedRunningTime="2026-07-27 20:57:59.446799223 +0000 UTC m=+23.712513342"
Jul 27 20:57:59.557384 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:57:59.557357    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 20:58:00.144880 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.144786    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T20:57:59.557379813Z","UUID":"e407efb1-4aa8-47c9-a0f1-aa104f4a4e78","Handler":null,"Name":"","Endpoint":""}
Jul 27 20:58:00.146333 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.146305    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 20:58:00.146487 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.146353    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 20:58:00.271651 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.271614    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:00.271831 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.271614    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:00.271831 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:00.271776    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:58:00.271948 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:00.271837    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:58:00.400909 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.400821    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2f6dc" event={"ID":"6fb06055-e1b1-41d1-8b71-c2ec4ada6c68","Type":"ContainerStarted","Data":"aa56e231d6de5e9ae23cc407ce9981441c773130a362add3c3c7f883f77d6c8d"}
Jul 27 20:58:00.403014 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.402987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd" event={"ID":"78a266dc-b8d5-4588-a448-2140db6bf281","Type":"ContainerStarted","Data":"fad6e9cb05b88a29919becf8b32314e457d3df4018635658353fbece98ffb22c"}
Jul 27 20:58:00.414658 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.414609    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8zdsh" podStartSLOduration=5.378312649 podStartE2EDuration="24.414593909s" totalImagesPullingTime="19.03628126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:57:59.467053093 +0000 UTC m=+23.732767213" watchObservedRunningTime="2026-07-27 20:58:00.414593909 +0000 UTC m=+24.680308217"
Jul 27 20:58:00.414787 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:00.414765    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2f6dc" podStartSLOduration=5.383886337 podStartE2EDuration="24.414758859s" totalImagesPullingTime="19.030872522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:00.414054261 +0000 UTC m=+24.679768380" watchObservedRunningTime="2026-07-27 20:58:00.414758859 +0000 UTC m=+24.680472977"
Jul 27 20:58:01.271386 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:01.271349    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:01.271540 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:01.271476    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:58:01.409640 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:01.409555    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"f0623ab0c911968a608dc78af0c0ca7c4ea7c8d94cf4cb7c0fdf26b9ba5c5193"}
Jul 27 20:58:01.412040 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:01.412009    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd" event={"ID":"78a266dc-b8d5-4588-a448-2140db6bf281","Type":"ContainerStarted","Data":"ec88b235914b3e901707fc3fa294425fab0c6c131616a55424a1d10cfe471bb1"}
Jul 27 20:58:01.431089 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:01.431040    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bmdgd" podStartSLOduration=4.400883057 podStartE2EDuration="25.431024932s" totalImagesPullingTime="21.030141875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:01.430961514 +0000 UTC m=+25.696675633" watchObservedRunningTime="2026-07-27 20:58:01.431024932 +0000 UTC m=+25.696739054"
Jul 27 20:58:02.272504 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:02.272277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:02.272699 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:02.272278    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:02.272699 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:02.272625    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:58:02.272817 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:02.272697    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:58:02.882390 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:02.882356    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:58:02.883304 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:02.883276    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:58:03.271830 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:03.271798    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:03.272001 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:03.271928    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:58:03.416765 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:03.416732    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:58:03.417384 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:03.417150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k2nhq"
Jul 27 20:58:04.272098 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:04.271900    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:04.272828 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:04.271946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:04.272828 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:04.272191    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:58:04.272828 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:04.272278    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:58:04.421874 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:04.421837    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" event={"ID":"5856ec0e-fb26-48ce-9a1f-7fb8e0504480","Type":"ContainerStarted","Data":"5534926b79649c2644dc458f4448905a5cc18f3bd5f327a67308ebf43e810d05"}
Jul 27 20:58:04.422117 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:04.422089    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:58:04.423739 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:04.423713    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c7f9a86-bdee-4f19-b74a-898fe54df0df" containerID="6614ecaa17d951bd6b98a57866e28857a021dde212dacf423c6802529681c4be" exitCode=0
Jul 27 20:58:04.423863 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:04.423780    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerDied","Data":"6614ecaa17d951bd6b98a57866e28857a021dde212dacf423c6802529681c4be"}
Jul 27 20:58:04.438912 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:04.438887    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:58:04.446132 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:04.446092    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh" podStartSLOduration=9.235688616 podStartE2EDuration="28.446079513s" totalImagesPullingTime="19.210390897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:04.445753999 +0000 UTC m=+28.711468119" watchObservedRunningTime="2026-07-27 20:58:04.446079513 +0000 UTC m=+28.711793631"
Jul 27 20:58:05.271355 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.271330    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:05.271705 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:05.271436    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:58:05.427651 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.427511    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:58:05.427651 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.427594    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:58:05.446744 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.446717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:58:05.685443 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.685409    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-825k6"]
Jul 27 20:58:05.685609 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.685587    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:05.685717 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:05.685689    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:58:05.688612 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.688588    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t55cm"]
Jul 27 20:58:05.688736 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.688687    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:05.688802 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:05.688766    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:58:05.689280 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.689260    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mqsw2"]
Jul 27 20:58:05.689376 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:05.689362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:05.689469 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:05.689452    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:58:06.431288 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:06.431256    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c7f9a86-bdee-4f19-b74a-898fe54df0df" containerID="2f37d8a4afd345ba000fd68dfbe5e532d19f0e28cdaa6f6144443192cd81a6a1" exitCode=0
Jul 27 20:58:06.431661 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:06.431343    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerDied","Data":"2f37d8a4afd345ba000fd68dfbe5e532d19f0e28cdaa6f6144443192cd81a6a1"}
Jul 27 20:58:07.271276 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:07.271244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:07.271424 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:07.271248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:07.271807 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:07.271418    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:58:07.271807 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:07.271447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:07.271807 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:07.271561    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:58:07.271807 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:07.271638    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:58:08.438193 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:08.438160    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c7f9a86-bdee-4f19-b74a-898fe54df0df" containerID="979c4bd59a7c8ef926487b9287058b08b9824e8aea05697f946517998b228c8d" exitCode=0
Jul 27 20:58:08.438193 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:08.438199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerDied","Data":"979c4bd59a7c8ef926487b9287058b08b9824e8aea05697f946517998b228c8d"}
Jul 27 20:58:09.272046 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:09.272015    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:09.272256 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:09.272016    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:09.272256 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.272148    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:58:09.272256 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:09.272016    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:09.272256 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.272229    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:58:09.272459 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.272290    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:58:09.834183 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:09.834151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:09.834655 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.834314    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:58:09.834655 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.834372    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:41.834358378 +0000 UTC m=+66.100072476 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 20:58:09.934634 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:09.934595    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:09.934634 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:09.934640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:09.934869 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.934749    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 20:58:09.934869 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.934760    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 20:58:09.934869 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.934775    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 20:58:09.934869 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.934786    2575 projected.go:196] Error preparing data for projected volume kube-api-access-4cx8z for pod openshift-network-diagnostics/network-check-target-t55cm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:58:09.934869 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.934821    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret podName:5f6948c8-6610-4973-8b75-9ee5f48f8c46 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:41.934800417 +0000 UTC m=+66.200514512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret") pod "global-pull-secret-syncer-825k6" (UID: "5f6948c8-6610-4973-8b75-9ee5f48f8c46") : object "kube-system"/"original-pull-secret" not registered
Jul 27 20:58:09.934869 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:09.934843    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z podName:34a54b10-f42f-49c8-93f3-7b489ec42f85 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:41.934828271 +0000 UTC m=+66.200542382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4cx8z" (UniqueName: "kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z") pod "network-check-target-t55cm" (UID: "34a54b10-f42f-49c8-93f3-7b489ec42f85") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 20:58:11.271488 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:11.271455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:11.271984 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:11.271577    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 20:58:11.271984 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:11.271931    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:11.272068 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:11.272031    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t55cm" podUID="34a54b10-f42f-49c8-93f3-7b489ec42f85"
Jul 27 20:58:11.272102 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:11.272073    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:11.272146 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:11.272119    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-825k6" podUID="5f6948c8-6610-4973-8b75-9ee5f48f8c46"
Jul 27 20:58:12.065169 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.065070    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-197.ec2.internal" event="NodeReady"
Jul 27 20:58:12.065350 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.065265    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 20:58:12.109592 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.109556    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dc4bz"]
Jul 27 20:58:12.112163 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.112137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.114852 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.114418    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 20:58:12.114852 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.114492    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 20:58:12.114852 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.114699    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvklp\""
Jul 27 20:58:12.117842 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.117820    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vk6qw"]
Jul 27 20:58:12.119341 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.119325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vk6qw"
Jul 27 20:58:12.123996 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.123971    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 20:58:12.124303 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.124285    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 20:58:12.124734 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.124712    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dc4bz"]
Jul 27 20:58:12.125353 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.125338    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5mn65\""
Jul 27 20:58:12.125353 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.125354    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 20:58:12.131516 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.131494    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vk6qw"]
Jul 27 20:58:12.251851 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.251819    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.251851 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.251856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef009756-bf54-4db9-9643-5d8893ad5662-cert\") pod \"ingress-canary-vk6qw\" (UID: \"ef009756-bf54-4db9-9643-5d8893ad5662\") " pod="openshift-ingress-canary/ingress-canary-vk6qw"
Jul 27 20:58:12.252076 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.251876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg999\" (UniqueName: \"kubernetes.io/projected/ef009756-bf54-4db9-9643-5d8893ad5662-kube-api-access-qg999\") pod \"ingress-canary-vk6qw\" (UID: \"ef009756-bf54-4db9-9643-5d8893ad5662\") " pod="openshift-ingress-canary/ingress-canary-vk6qw"
Jul 27 20:58:12.252076 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.251967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkvxc\" (UniqueName: \"kubernetes.io/projected/e2fab966-db3e-4b31-b267-86a540c056d1-kube-api-access-kkvxc\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.252076 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.252011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2fab966-db3e-4b31-b267-86a540c056d1-config-volume\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.252076 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.252027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2fab966-db3e-4b31-b267-86a540c056d1-tmp-dir\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.352998 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.352974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.353508 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.353005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef009756-bf54-4db9-9643-5d8893ad5662-cert\") pod \"ingress-canary-vk6qw\" (UID: \"ef009756-bf54-4db9-9643-5d8893ad5662\") " pod="openshift-ingress-canary/ingress-canary-vk6qw"
Jul 27 20:58:12.353508 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.353023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg999\" (UniqueName: \"kubernetes.io/projected/ef009756-bf54-4db9-9643-5d8893ad5662-kube-api-access-qg999\") pod \"ingress-canary-vk6qw\" (UID: \"ef009756-bf54-4db9-9643-5d8893ad5662\") " pod="openshift-ingress-canary/ingress-canary-vk6qw"
Jul 27 20:58:12.353508 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:12.353150    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:12.353508 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:12.353242    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:12.853201943 +0000 UTC m=+37.118916055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:12.353508 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.353348    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkvxc\" (UniqueName: \"kubernetes.io/projected/e2fab966-db3e-4b31-b267-86a540c056d1-kube-api-access-kkvxc\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.353508 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.353429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2fab966-db3e-4b31-b267-86a540c056d1-config-volume\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.353508 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.353456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2fab966-db3e-4b31-b267-86a540c056d1-tmp-dir\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.353842 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.353823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2fab966-db3e-4b31-b267-86a540c056d1-tmp-dir\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.354086 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.354054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2fab966-db3e-4b31-b267-86a540c056d1-config-volume\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.357655 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.357635    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef009756-bf54-4db9-9643-5d8893ad5662-cert\") pod \"ingress-canary-vk6qw\" (UID: \"ef009756-bf54-4db9-9643-5d8893ad5662\") " pod="openshift-ingress-canary/ingress-canary-vk6qw"
Jul 27 20:58:12.363853 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.363836    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkvxc\" (UniqueName: \"kubernetes.io/projected/e2fab966-db3e-4b31-b267-86a540c056d1-kube-api-access-kkvxc\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.363999 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.363981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg999\" (UniqueName: \"kubernetes.io/projected/ef009756-bf54-4db9-9643-5d8893ad5662-kube-api-access-qg999\") pod \"ingress-canary-vk6qw\" (UID: \"ef009756-bf54-4db9-9643-5d8893ad5662\") " pod="openshift-ingress-canary/ingress-canary-vk6qw"
Jul 27 20:58:12.432236 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.432191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vk6qw"
Jul 27 20:58:12.451653 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.451454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerStarted","Data":"4c51eb1fa96f2daf31f3111cea0ade3b03bfd857d4717886399b00b047e78373"}
Jul 27 20:58:12.572771 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.572740    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vk6qw"]
Jul 27 20:58:12.576852 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:58:12.576822    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef009756_bf54_4db9_9643_5d8893ad5662.slice/crio-5e7acab6bf931e2c69f205fae76e94ee389c13e7f10fadce3678bb5d69cb1954 WatchSource:0}: Error finding container 5e7acab6bf931e2c69f205fae76e94ee389c13e7f10fadce3678bb5d69cb1954: Status 404 returned error can't find the container with id 5e7acab6bf931e2c69f205fae76e94ee389c13e7f10fadce3678bb5d69cb1954
Jul 27 20:58:12.857055 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:12.856976    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:12.857178 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:12.857130    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:12.857254 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:12.857189    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:13.857174098 +0000 UTC m=+38.122888194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:13.271984 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.271948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:13.271984 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.271978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:13.272196 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.271981    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:13.276126 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.275914    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cxsx8\""
Jul 27 20:58:13.276126 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.275914    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:58:13.276126 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.276020    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:58:13.276126 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.276050    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:58:13.276126 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.276085    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hn7dl\""
Jul 27 20:58:13.276413 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.276132    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:58:13.457465 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.457428    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c7f9a86-bdee-4f19-b74a-898fe54df0df" containerID="4c51eb1fa96f2daf31f3111cea0ade3b03bfd857d4717886399b00b047e78373" exitCode=0
Jul 27 20:58:13.457917 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.457512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerDied","Data":"4c51eb1fa96f2daf31f3111cea0ade3b03bfd857d4717886399b00b047e78373"}
Jul 27 20:58:13.458912 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.458683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vk6qw" event={"ID":"ef009756-bf54-4db9-9643-5d8893ad5662","Type":"ContainerStarted","Data":"5e7acab6bf931e2c69f205fae76e94ee389c13e7f10fadce3678bb5d69cb1954"}
Jul 27 20:58:13.863365 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:13.863288    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:13.863499 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:13.863407    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:13.863499 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:13.863468    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:15.863450398 +0000 UTC m=+40.129164495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:14.464690 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:14.464660    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c7f9a86-bdee-4f19-b74a-898fe54df0df" containerID="e7404507853d6db99b717ec303305a976143f3990ffe94a15b6b1ca8ee229886" exitCode=0
Jul 27 20:58:14.465091 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:14.464715    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerDied","Data":"e7404507853d6db99b717ec303305a976143f3990ffe94a15b6b1ca8ee229886"}
Jul 27 20:58:15.470416 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:15.470173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" event={"ID":"5c7f9a86-bdee-4f19-b74a-898fe54df0df","Type":"ContainerStarted","Data":"482dbf02782fe66a61f5680d0e9ea1c247e570fc61533eca0d417280caf2bc3e"}
Jul 27 20:58:15.471564 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:15.471543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vk6qw" event={"ID":"ef009756-bf54-4db9-9643-5d8893ad5662","Type":"ContainerStarted","Data":"085767bd3bdc5d3b7c049012d991fbc406c93be7d5989f21598c395bb76df0fa"}
Jul 27 20:58:15.492009 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:15.491973    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gvq9q" podStartSLOduration=10.321301465 podStartE2EDuration="39.491960392s" totalImagesPullingTime="29.170658927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:15.490626835 +0000 UTC m=+39.756340953" watchObservedRunningTime="2026-07-27 20:58:15.491960392 +0000 UTC m=+39.757674509"
Jul 27 20:58:15.506953 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:15.506886    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vk6qw" podStartSLOduration=1.314060576 podStartE2EDuration="3.506876926s" totalImagesPullingTime="2.19281635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:15.506200732 +0000 UTC m=+39.771914850" watchObservedRunningTime="2026-07-27 20:58:15.506876926 +0000 UTC m=+39.772591044"
Jul 27 20:58:15.878603 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:15.878494    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:15.878784 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:15.878631    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:15.878784 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:15.878690    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:19.878673847 +0000 UTC m=+44.144387943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:19.904003 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:19.903962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:19.904429 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:19.904092    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:19.904429 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:19.904149    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:27.904133731 +0000 UTC m=+52.169847832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:27.960669 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:27.960633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:27.961118 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:27.960789    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:27.961118 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:27.960855    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 20:58:43.960837753 +0000 UTC m=+68.226551849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:36.671141 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.671109    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"]
Jul 27 20:58:36.696245 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.696200    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"]
Jul 27 20:58:36.696384 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.696307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 20:58:36.698883 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.698860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 20:58:36.699151 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.699135    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 20:58:36.700129 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.700109    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-tpr25\""
Jul 27 20:58:36.700447 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.700429    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 20:58:36.700578 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.700564    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 20:58:36.710258 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.710238    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"]
Jul 27 20:58:36.710359 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.710263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"]
Jul 27 20:58:36.710359 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.710295    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.712949 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.712933    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 20:58:36.820090 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.820058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3b73a30-967d-4afa-b25e-486a336be2ef-tmp\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.820090 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.820089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a47c7a1b-f0ca-4312-bc36-8be87577c7fa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5df5f789b4-6prts\" (UID: \"a47c7a1b-f0ca-4312-bc36-8be87577c7fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 20:58:36.820303 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.820112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zzcm\" (UniqueName: \"kubernetes.io/projected/a47c7a1b-f0ca-4312-bc36-8be87577c7fa-kube-api-access-8zzcm\") pod \"managed-serviceaccount-addon-agent-5df5f789b4-6prts\" (UID: \"a47c7a1b-f0ca-4312-bc36-8be87577c7fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 20:58:36.820303 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.820182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3b73a30-967d-4afa-b25e-486a336be2ef-klusterlet-config\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.820303 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.820240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt5cq\" (UniqueName: \"kubernetes.io/projected/d3b73a30-967d-4afa-b25e-486a336be2ef-kube-api-access-vt5cq\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.921072 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.921041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3b73a30-967d-4afa-b25e-486a336be2ef-tmp\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.921072 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.921069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a47c7a1b-f0ca-4312-bc36-8be87577c7fa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5df5f789b4-6prts\" (UID: \"a47c7a1b-f0ca-4312-bc36-8be87577c7fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 20:58:36.921321 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.921090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zzcm\" (UniqueName: \"kubernetes.io/projected/a47c7a1b-f0ca-4312-bc36-8be87577c7fa-kube-api-access-8zzcm\") pod \"managed-serviceaccount-addon-agent-5df5f789b4-6prts\" (UID: \"a47c7a1b-f0ca-4312-bc36-8be87577c7fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 20:58:36.921321 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.921227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3b73a30-967d-4afa-b25e-486a336be2ef-klusterlet-config\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.921321 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.921273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt5cq\" (UniqueName: \"kubernetes.io/projected/d3b73a30-967d-4afa-b25e-486a336be2ef-kube-api-access-vt5cq\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.921479 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.921414    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3b73a30-967d-4afa-b25e-486a336be2ef-tmp\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.925312 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.925293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a47c7a1b-f0ca-4312-bc36-8be87577c7fa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5df5f789b4-6prts\" (UID: \"a47c7a1b-f0ca-4312-bc36-8be87577c7fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 20:58:36.925312 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.925304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d3b73a30-967d-4afa-b25e-486a336be2ef-klusterlet-config\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.929647 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.929627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt5cq\" (UniqueName: \"kubernetes.io/projected/d3b73a30-967d-4afa-b25e-486a336be2ef-kube-api-access-vt5cq\") pod \"klusterlet-addon-workmgr-7648676769-684qk\" (UID: \"d3b73a30-967d-4afa-b25e-486a336be2ef\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:36.929737 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:36.929674    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zzcm\" (UniqueName: \"kubernetes.io/projected/a47c7a1b-f0ca-4312-bc36-8be87577c7fa-kube-api-access-8zzcm\") pod \"managed-serviceaccount-addon-agent-5df5f789b4-6prts\" (UID: \"a47c7a1b-f0ca-4312-bc36-8be87577c7fa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 20:58:37.013852 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:37.013824    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 20:58:37.020057 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:37.020034    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:37.157307 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:37.157024    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"]
Jul 27 20:58:37.162157 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:58:37.162117    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda47c7a1b_f0ca_4312_bc36_8be87577c7fa.slice/crio-32d2a7ea5606af97710249dd2954cdadfe4d53d00959f18c422542759263cf5e WatchSource:0}: Error finding container 32d2a7ea5606af97710249dd2954cdadfe4d53d00959f18c422542759263cf5e: Status 404 returned error can't find the container with id 32d2a7ea5606af97710249dd2954cdadfe4d53d00959f18c422542759263cf5e
Jul 27 20:58:37.172730 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:37.172683    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"]
Jul 27 20:58:37.175097 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:58:37.175073    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b73a30_967d_4afa_b25e_486a336be2ef.slice/crio-f371a3f825bb0158a850ffe7aa8f0293b673fd403f6366225d749e7b3a424a90 WatchSource:0}: Error finding container f371a3f825bb0158a850ffe7aa8f0293b673fd403f6366225d749e7b3a424a90: Status 404 returned error can't find the container with id f371a3f825bb0158a850ffe7aa8f0293b673fd403f6366225d749e7b3a424a90
Jul 27 20:58:37.453776 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:37.453710    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zhxxh"
Jul 27 20:58:37.524702 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:37.524668    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" event={"ID":"d3b73a30-967d-4afa-b25e-486a336be2ef","Type":"ContainerStarted","Data":"f371a3f825bb0158a850ffe7aa8f0293b673fd403f6366225d749e7b3a424a90"}
Jul 27 20:58:37.525676 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:37.525652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" event={"ID":"a47c7a1b-f0ca-4312-bc36-8be87577c7fa","Type":"ContainerStarted","Data":"32d2a7ea5606af97710249dd2954cdadfe4d53d00959f18c422542759263cf5e"}
Jul 27 20:58:40.536285 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:40.536247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" event={"ID":"a47c7a1b-f0ca-4312-bc36-8be87577c7fa","Type":"ContainerStarted","Data":"406f17d10e4f7f6188679458fb0cd25d25233662704a5682ef58a87803f3d61f"}
Jul 27 20:58:40.551688 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:40.551632    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" podStartSLOduration=1.598072605 podStartE2EDuration="4.551617006s" totalImagesPullingTime="2.953544401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:40.550079965 +0000 UTC m=+64.815794083" watchObservedRunningTime="2026-07-27 20:58:40.551617006 +0000 UTC m=+64.817331123"
Jul 27 20:58:41.543354 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.543318    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" event={"ID":"d3b73a30-967d-4afa-b25e-486a336be2ef","Type":"ContainerStarted","Data":"a13e208994e22149ac8ba73745e4f31e4e2e7fe4e053ad074cd72abc64d0f5e6"}
Jul 27 20:58:41.558647 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.558606    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" podStartSLOduration=1.387757367 podStartE2EDuration="5.558594215s" totalImagesPullingTime="4.170836848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:41.557981992 +0000 UTC m=+65.823696109" watchObservedRunningTime="2026-07-27 20:58:41.558594215 +0000 UTC m=+65.824308333"
Jul 27 20:58:41.860560 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.860514    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:58:41.862935 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.862916    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 20:58:41.870893 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:41.870874    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 20:58:41.870960 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:41.870937    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 20:59:45.870920852 +0000 UTC m=+130.136634951 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : secret "metrics-daemon-secret" not found
Jul 27 20:58:41.961292 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.961254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:41.961436 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.961342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:41.963549 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.963529    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 20:58:41.963658 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.963644    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 20:58:41.974096 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.974079    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 20:58:41.974818 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.974800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f6948c8-6610-4973-8b75-9ee5f48f8c46-original-pull-secret\") pod \"global-pull-secret-syncer-825k6\" (UID: \"5f6948c8-6610-4973-8b75-9ee5f48f8c46\") " pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:41.985189 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:41.985168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cx8z\" (UniqueName: \"kubernetes.io/projected/34a54b10-f42f-49c8-93f3-7b489ec42f85-kube-api-access-4cx8z\") pod \"network-check-target-t55cm\" (UID: \"34a54b10-f42f-49c8-93f3-7b489ec42f85\") " pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:42.093862 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.093836    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hn7dl\""
Jul 27 20:58:42.097707 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.097693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-825k6"
Jul 27 20:58:42.102582 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.102568    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:42.221689 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.221658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-825k6"]
Jul 27 20:58:42.225014 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:58:42.224984    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6948c8_6610_4973_8b75_9ee5f48f8c46.slice/crio-f1ae77def410e23f0c6205ef8c668a61efe8c68cba6d49f1d4ad7aa6353b2489 WatchSource:0}: Error finding container f1ae77def410e23f0c6205ef8c668a61efe8c68cba6d49f1d4ad7aa6353b2489: Status 404 returned error can't find the container with id f1ae77def410e23f0c6205ef8c668a61efe8c68cba6d49f1d4ad7aa6353b2489
Jul 27 20:58:42.237868 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.237846    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t55cm"]
Jul 27 20:58:42.240282 ip-10-0-131-197 kubenswrapper[2575]: W0727 20:58:42.240249    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a54b10_f42f_49c8_93f3_7b489ec42f85.slice/crio-6fa87373cf8a02c8a1a387abad44e996971587af9c0afeeaba4ea3e2435468a8 WatchSource:0}: Error finding container 6fa87373cf8a02c8a1a387abad44e996971587af9c0afeeaba4ea3e2435468a8: Status 404 returned error can't find the container with id 6fa87373cf8a02c8a1a387abad44e996971587af9c0afeeaba4ea3e2435468a8
Jul 27 20:58:42.546387 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.546352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t55cm" event={"ID":"34a54b10-f42f-49c8-93f3-7b489ec42f85","Type":"ContainerStarted","Data":"6fa87373cf8a02c8a1a387abad44e996971587af9c0afeeaba4ea3e2435468a8"}
Jul 27 20:58:42.547435 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.547415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-825k6" event={"ID":"5f6948c8-6610-4973-8b75-9ee5f48f8c46","Type":"ContainerStarted","Data":"f1ae77def410e23f0c6205ef8c668a61efe8c68cba6d49f1d4ad7aa6353b2489"}
Jul 27 20:58:42.547640 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.547624    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:42.549166 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:42.549150    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 20:58:43.979411 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:43.979378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:58:43.979832 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:43.979515    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:58:43.979832 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:58:43.979572    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 20:59:15.979556823 +0000 UTC m=+100.245270919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 20:58:47.565055 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:47.565018    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t55cm" event={"ID":"34a54b10-f42f-49c8-93f3-7b489ec42f85","Type":"ContainerStarted","Data":"bc1092a5ea657edd778d9822a75996a75398e4b71d9f5b06dabeb3fbec21f827"}
Jul 27 20:58:47.565558 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:47.565079    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:58:47.566489 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:47.566465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-825k6" event={"ID":"5f6948c8-6610-4973-8b75-9ee5f48f8c46","Type":"ContainerStarted","Data":"1d6d5faef799875e5154143786821178fe933ab34fafa27fde0de7ec093aa520"}
Jul 27 20:58:47.579532 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:47.579490    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t55cm" podStartSLOduration=67.192987135 podStartE2EDuration="1m11.57947445s" totalImagesPullingTime="4.386487315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:47.57907203 +0000 UTC m=+71.844786149" watchObservedRunningTime="2026-07-27 20:58:47.57947445 +0000 UTC m=+71.845188568"
Jul 27 20:58:47.593494 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:58:47.593457    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-825k6" podStartSLOduration=67.189032595 podStartE2EDuration="1m11.593446098s" totalImagesPullingTime="4.404413503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:58:47.592952985 +0000 UTC m=+71.858667104" watchObservedRunningTime="2026-07-27 20:58:47.593446098 +0000 UTC m=+71.859160215"
Jul 27 20:59:15.989579 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:59:15.989539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 20:59:15.989976 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:59:15.989699    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 20:59:15.989976 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:59:15.989776    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 21:00:19.98975953 +0000 UTC m=+164.255473626 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 20:59:18.571175 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:59:18.571142    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t55cm"
Jul 27 20:59:45.889060 ip-10-0-131-197 kubenswrapper[2575]: I0727 20:59:45.889023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 20:59:45.889558 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:59:45.889152    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 20:59:45.889558 ip-10-0-131-197 kubenswrapper[2575]: E0727 20:59:45.889251    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 21:01:47.88922873 +0000 UTC m=+252.154942842 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : secret "metrics-daemon-secret" not found
Jul 27 21:00:15.124360 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:00:15.124320    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dc4bz" podUID="e2fab966-db3e-4b31-b267-86a540c056d1"
Jul 27 21:00:15.775871 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:15.775838    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dc4bz"
Jul 27 21:00:16.283579 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:00:16.283543    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 21:00:20.016664 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:20.016610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 21:00:20.017064 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:00:20.016757    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 21:00:20.017064 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:00:20.016833    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls podName:e2fab966-db3e-4b31-b267-86a540c056d1 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:22.01681469 +0000 UTC m=+286.282528789 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls") pod "dns-default-dc4bz" (UID: "e2fab966-db3e-4b31-b267-86a540c056d1") : secret "dns-default-metrics-tls" not found
Jul 27 21:00:28.272229 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:28.272136    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 21:00:40.840539 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:40.840505    2575 generic.go:356] "Generic (PLEG): container finished" podID="a47c7a1b-f0ca-4312-bc36-8be87577c7fa" containerID="406f17d10e4f7f6188679458fb0cd25d25233662704a5682ef58a87803f3d61f" exitCode=255
Jul 27 21:00:40.840908 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:40.840554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" event={"ID":"a47c7a1b-f0ca-4312-bc36-8be87577c7fa","Type":"ContainerDied","Data":"406f17d10e4f7f6188679458fb0cd25d25233662704a5682ef58a87803f3d61f"}
Jul 27 21:00:40.846000 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:40.845981    2575 scope.go:117] "RemoveContainer" containerID="406f17d10e4f7f6188679458fb0cd25d25233662704a5682ef58a87803f3d61f"
Jul 27 21:00:41.845149 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:41.845111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" event={"ID":"a47c7a1b-f0ca-4312-bc36-8be87577c7fa","Type":"ContainerStarted","Data":"2a6c1f5d61b1a9376849a404652a83e2cf5d6d4fc8f3d06367947f548713f144"}
Jul 27 21:00:41.846546 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:41.846520    2575 generic.go:356] "Generic (PLEG): container finished" podID="d3b73a30-967d-4afa-b25e-486a336be2ef" containerID="a13e208994e22149ac8ba73745e4f31e4e2e7fe4e053ad074cd72abc64d0f5e6" exitCode=1
Jul 27 21:00:41.846661 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:41.846583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" event={"ID":"d3b73a30-967d-4afa-b25e-486a336be2ef","Type":"ContainerDied","Data":"a13e208994e22149ac8ba73745e4f31e4e2e7fe4e053ad074cd72abc64d0f5e6"}
Jul 27 21:00:41.846854 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:41.846842    2575 scope.go:117] "RemoveContainer" containerID="a13e208994e22149ac8ba73745e4f31e4e2e7fe4e053ad074cd72abc64d0f5e6"
Jul 27 21:00:42.548499 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:42.548454    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 21:00:42.851724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:42.851642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" event={"ID":"d3b73a30-967d-4afa-b25e-486a336be2ef","Type":"ContainerStarted","Data":"6262f8aafbb4327e583ba424696606de20a5ea178e68b6e6591b5309e7b87073"}
Jul 27 21:00:42.852132 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:42.851852    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 21:00:42.852469 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:00:42.852450    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 21:01:47.919436 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:47.919403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 21:01:47.919902 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:47.919550    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 21:01:47.919902 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:47.919628    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs podName:2ee7da33-7e2e-4467-b6d6-54f885d4d067 nodeName:}" failed. No retries permitted until 2026-07-27 21:03:49.919611352 +0000 UTC m=+374.185325447 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs") pod "network-metrics-daemon-mqsw2" (UID: "2ee7da33-7e2e-4467-b6d6-54f885d4d067") : secret "metrics-daemon-secret" not found
Jul 27 21:01:53.636573 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.636541    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"]
Jul 27 21:01:53.638267 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.638252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.641650 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.641630    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 21:01:53.641892 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.641847    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hq5fr\""
Jul 27 21:01:53.642556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.642538    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 21:01:53.642664 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.642572    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 21:01:53.642664 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.642616    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:01:53.661018 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.660998    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"]
Jul 27 21:01:53.724870 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.724847    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8"]
Jul 27 21:01:53.726703 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.726688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8"
Jul 27 21:01:53.728937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.728919    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kcln8\""
Jul 27 21:01:53.731733 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.731677    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-578f8d645c-2qc9f"]
Jul 27 21:01:53.733427 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.733402    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.735610 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.735594    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5xm6l\""
Jul 27 21:01:53.735696 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.735644    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 21:01:53.735696 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.735680    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 21:01:53.735913 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.735895    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 21:01:53.737300 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.737280    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8"]
Jul 27 21:01:53.745568 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.745549    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 21:01:53.752149 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.752127    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-578f8d645c-2qc9f"]
Jul 27 21:01:53.756414 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.756385    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.756499 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.756449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfds\" (UniqueName: \"kubernetes.io/projected/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-kube-api-access-4dfds\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.756552 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.756497    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-config\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.857555 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b40caad-9840-4418-9022-744b7042184d-ca-trust-extracted\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.857696 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh4fk\" (UniqueName: \"kubernetes.io/projected/2b785e27-b9b5-45ee-bb8a-da7c9e0451d4-kube-api-access-lh4fk\") pod \"network-check-source-7d88cb55d8-nqks8\" (UID: \"2b785e27-b9b5-45ee-bb8a-da7c9e0451d4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8"
Jul 27 21:01:53.857696 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.857696 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-trusted-ca\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.857696 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9bv\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-kube-api-access-rl9bv\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.857911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.857911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-bound-sa-token\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.857911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfds\" (UniqueName: \"kubernetes.io/projected/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-kube-api-access-4dfds\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.857911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-image-registry-private-configuration\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.857911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857862    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-registry-certificates\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.857911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-config\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.858151 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.857932    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-installation-pull-secrets\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.858416 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.858396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-config\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.860169 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.860146    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.865626 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.865605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfds\" (UniqueName: \"kubernetes.io/projected/83f10c36-22bf-4a4f-96de-9f01ec45ad4a-kube-api-access-4dfds\") pod \"service-ca-operator-5d6c75f84f-dbkxc\" (UID: \"83f10c36-22bf-4a4f-96de-9f01ec45ad4a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.946786 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.946715    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"
Jul 27 21:01:53.958787 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.958765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b40caad-9840-4418-9022-744b7042184d-ca-trust-extracted\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.958901 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.958795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh4fk\" (UniqueName: \"kubernetes.io/projected/2b785e27-b9b5-45ee-bb8a-da7c9e0451d4-kube-api-access-lh4fk\") pod \"network-check-source-7d88cb55d8-nqks8\" (UID: \"2b785e27-b9b5-45ee-bb8a-da7c9e0451d4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8"
Jul 27 21:01:53.958901 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.958814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.958901 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.958829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-trusted-ca\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.958901 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.958848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9bv\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-kube-api-access-rl9bv\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.958901 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.958888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-bound-sa-token\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.959185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.958926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-image-registry-private-configuration\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.959185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.958957    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-registry-certificates\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.959185 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:53.958989    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:01:53.959185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.959005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-installation-pull-secrets\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.959185 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:53.959011    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578f8d645c-2qc9f: secret "image-registry-tls" not found
Jul 27 21:01:53.959185 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:53.959084    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls podName:2b40caad-9840-4418-9022-744b7042184d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:54.459063437 +0000 UTC m=+258.724777554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls") pod "image-registry-578f8d645c-2qc9f" (UID: "2b40caad-9840-4418-9022-744b7042184d") : secret "image-registry-tls" not found
Jul 27 21:01:53.959555 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.959185    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b40caad-9840-4418-9022-744b7042184d-ca-trust-extracted\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.959712 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.959687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-registry-certificates\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.960271 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.960199    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-trusted-ca\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.961747 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.961724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-installation-pull-secrets\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.961916 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.961893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-image-registry-private-configuration\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.969080 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.969061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9bv\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-kube-api-access-rl9bv\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:53.969166 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.969102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh4fk\" (UniqueName: \"kubernetes.io/projected/2b785e27-b9b5-45ee-bb8a-da7c9e0451d4-kube-api-access-lh4fk\") pod \"network-check-source-7d88cb55d8-nqks8\" (UID: \"2b785e27-b9b5-45ee-bb8a-da7c9e0451d4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8"
Jul 27 21:01:53.969634 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:53.969618    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-bound-sa-token\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:54.035285 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:54.035258    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8"
Jul 27 21:01:54.067474 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:54.067433    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc"]
Jul 27 21:01:54.072628 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:01:54.072590    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f10c36_22bf_4a4f_96de_9f01ec45ad4a.slice/crio-af44fd0ca2e0b252d24a106a019865bc91412db97ca57decc97d9cd098c45032 WatchSource:0}: Error finding container af44fd0ca2e0b252d24a106a019865bc91412db97ca57decc97d9cd098c45032: Status 404 returned error can't find the container with id af44fd0ca2e0b252d24a106a019865bc91412db97ca57decc97d9cd098c45032
Jul 27 21:01:54.160508 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:54.160474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8"]
Jul 27 21:01:54.164013 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:01:54.163994    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b785e27_b9b5_45ee_bb8a_da7c9e0451d4.slice/crio-94a7be533bd7c20c77a5de4484607d981f02ff02d3310a3d9e97edda4057dfd5 WatchSource:0}: Error finding container 94a7be533bd7c20c77a5de4484607d981f02ff02d3310a3d9e97edda4057dfd5: Status 404 returned error can't find the container with id 94a7be533bd7c20c77a5de4484607d981f02ff02d3310a3d9e97edda4057dfd5
Jul 27 21:01:54.462813 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:54.462742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:54.462954 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:54.462883    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:01:54.462954 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:54.462898    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578f8d645c-2qc9f: secret "image-registry-tls" not found
Jul 27 21:01:54.462954 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:54.462950    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls podName:2b40caad-9840-4418-9022-744b7042184d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:55.462934533 +0000 UTC m=+259.728648630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls") pod "image-registry-578f8d645c-2qc9f" (UID: "2b40caad-9840-4418-9022-744b7042184d") : secret "image-registry-tls" not found
Jul 27 21:01:55.050818 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:55.050778    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8" event={"ID":"2b785e27-b9b5-45ee-bb8a-da7c9e0451d4","Type":"ContainerStarted","Data":"70cd5f4ca7d34a5a2b10055fc342028c4abfc8a1415f801c8168f681971ff747"}
Jul 27 21:01:55.051300 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:55.050841    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8" event={"ID":"2b785e27-b9b5-45ee-bb8a-da7c9e0451d4","Type":"ContainerStarted","Data":"94a7be533bd7c20c77a5de4484607d981f02ff02d3310a3d9e97edda4057dfd5"}
Jul 27 21:01:55.051920 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:55.051898    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc" event={"ID":"83f10c36-22bf-4a4f-96de-9f01ec45ad4a","Type":"ContainerStarted","Data":"af44fd0ca2e0b252d24a106a019865bc91412db97ca57decc97d9cd098c45032"}
Jul 27 21:01:55.065672 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:55.065620    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nqks8" podStartSLOduration=2.065603083 podStartE2EDuration="2.065603083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:55.06523007 +0000 UTC m=+259.330944187" watchObservedRunningTime="2026-07-27 21:01:55.065603083 +0000 UTC m=+259.331317181"
Jul 27 21:01:55.469574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:55.469475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:55.469780 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:55.469626    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:01:55.469780 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:55.469639    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578f8d645c-2qc9f: secret "image-registry-tls" not found
Jul 27 21:01:55.469780 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:55.469697    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls podName:2b40caad-9840-4418-9022-744b7042184d nodeName:}" failed. No retries permitted until 2026-07-27 21:01:57.46968062 +0000 UTC m=+261.735394721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls") pod "image-registry-578f8d645c-2qc9f" (UID: "2b40caad-9840-4418-9022-744b7042184d") : secret "image-registry-tls" not found
Jul 27 21:01:57.060352 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:57.060318    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc" event={"ID":"83f10c36-22bf-4a4f-96de-9f01ec45ad4a","Type":"ContainerStarted","Data":"8ea61633bee2eff2963cd99f0742663404d89b2b52488148b96d24cf196e61db"}
Jul 27 21:01:57.079007 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:57.078931    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc" podStartSLOduration=1.637570588 podStartE2EDuration="4.078912913s" totalImagesPullingTime="2.441342325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:01:57.078046885 +0000 UTC m=+261.343760994" watchObservedRunningTime="2026-07-27 21:01:57.078912913 +0000 UTC m=+261.344627033"
Jul 27 21:01:57.483492 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:57.483405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:01:57.483653 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:57.483521    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:01:57.483653 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:57.483533    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578f8d645c-2qc9f: secret "image-registry-tls" not found
Jul 27 21:01:57.483653 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:57.483580    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls podName:2b40caad-9840-4418-9022-744b7042184d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.483566883 +0000 UTC m=+265.749280979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls") pod "image-registry-578f8d645c-2qc9f" (UID: "2b40caad-9840-4418-9022-744b7042184d") : secret "image-registry-tls" not found
Jul 27 21:01:58.099339 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.099305    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9dkn4"]
Jul 27 21:01:58.101370 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.101354    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.104695 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.104674    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 21:01:58.104695 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.104688    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 21:01:58.104874 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.104753    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g6v4k\""
Jul 27 21:01:58.105555 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.105530    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 21:01:58.105555 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.105547    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 21:01:58.116512 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.116492    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9dkn4"]
Jul 27 21:01:58.189189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.189157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.189372 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.189202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-crio-socket\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.189372 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.189311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.189468 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.189372    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcnrk\" (UniqueName: \"kubernetes.io/projected/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-api-access-jcnrk\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.189468 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.189396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-data-volume\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.290449 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.290421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcnrk\" (UniqueName: \"kubernetes.io/projected/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-api-access-jcnrk\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.290449 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.290451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-data-volume\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.290649 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.290497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.290649 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.290513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-crio-socket\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.290649 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.290557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.290649 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:58.290630    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:58.290649 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.290634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-crio-socket\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.290839 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:58.290636    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:01:58.290839 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:58.290703    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:01:58.790683502 +0000 UTC m=+263.056397613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:58.290839 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:58.290731    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:01:58.790711828 +0000 UTC m=+263.056425944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : configmap "kube-rbac-proxy" not found
Jul 27 21:01:58.290948 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.290866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-data-volume\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.298692 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.298669    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcnrk\" (UniqueName: \"kubernetes.io/projected/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-api-access-jcnrk\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.794429 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.794392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.794612 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:58.794459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:58.794612 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:58.794526    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:01:58.794612 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:58.794544    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:58.794612 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:58.794587    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:01:59.794572045 +0000 UTC m=+264.060286140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : configmap "kube-rbac-proxy" not found
Jul 27 21:01:58.794612 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:58.794606    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:01:59.794593212 +0000 UTC m=+264.060307308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:59.802238 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:59.802190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:59.802705 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:01:59.802273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:01:59.802705 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:59.802334    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:01:59.802705 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:59.802370    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:01:59.802705 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:59.802429    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.80240769 +0000 UTC m=+266.068121797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : configmap "kube-rbac-proxy" not found
Jul 27 21:01:59.802705 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:01:59.802449    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:02:01.802441057 +0000 UTC m=+266.068155153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:00.286847 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.286819    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vwt8s_6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260/dns-node-resolver/0.log"
Jul 27 21:02:00.985802 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.985772    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vjqx4"]
Jul 27 21:02:00.987825 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.987809    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:00.990378 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.990354    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 21:02:00.990378 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.990354    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 21:02:00.990566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.990364    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 21:02:00.991391 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.991371    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 21:02:00.991547 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.991371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5ctft\""
Jul 27 21:02:00.999423 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:00.999389    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vjqx4"]
Jul 27 21:02:01.086740 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.086714    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v7f7j_15c13300-9c10-484f-b56e-e99e18d3d4d8/node-ca/0.log"
Jul 27 21:02:01.112514 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.112493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/046f1083-be24-4088-976b-a05755298096-signing-key\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.112592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.112542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2chs\" (UniqueName: \"kubernetes.io/projected/046f1083-be24-4088-976b-a05755298096-kube-api-access-w2chs\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.112637 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.112622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/046f1083-be24-4088-976b-a05755298096-signing-cabundle\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.213295 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.213268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/046f1083-be24-4088-976b-a05755298096-signing-key\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.213396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.213314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2chs\" (UniqueName: \"kubernetes.io/projected/046f1083-be24-4088-976b-a05755298096-kube-api-access-w2chs\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.213396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.213361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/046f1083-be24-4088-976b-a05755298096-signing-cabundle\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.214067 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.213975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/046f1083-be24-4088-976b-a05755298096-signing-cabundle\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.215725 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.215705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/046f1083-be24-4088-976b-a05755298096-signing-key\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.221882 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.221860    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2chs\" (UniqueName: \"kubernetes.io/projected/046f1083-be24-4088-976b-a05755298096-kube-api-access-w2chs\") pod \"service-ca-658d7b7c78-vjqx4\" (UID: \"046f1083-be24-4088-976b-a05755298096\") " pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.297083 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.297019    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4"
Jul 27 21:02:01.433581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.433554    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-vjqx4"]
Jul 27 21:02:01.436179 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:01.436157    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod046f1083_be24_4088_976b_a05755298096.slice/crio-219ddf74dfa8d9b24ad6a4bc20c2e18b7651873376540f358e90d942fbce6dc5 WatchSource:0}: Error finding container 219ddf74dfa8d9b24ad6a4bc20c2e18b7651873376540f358e90d942fbce6dc5: Status 404 returned error can't find the container with id 219ddf74dfa8d9b24ad6a4bc20c2e18b7651873376540f358e90d942fbce6dc5
Jul 27 21:02:01.515968 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.515941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:02:01.516114 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:01.516094    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 21:02:01.516155 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:01.516117    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-578f8d645c-2qc9f: secret "image-registry-tls" not found
Jul 27 21:02:01.516193 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:01.516164    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls podName:2b40caad-9840-4418-9022-744b7042184d nodeName:}" failed. No retries permitted until 2026-07-27 21:02:09.516150146 +0000 UTC m=+273.781864242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls") pod "image-registry-578f8d645c-2qc9f" (UID: "2b40caad-9840-4418-9022-744b7042184d") : secret "image-registry-tls" not found
Jul 27 21:02:01.817817 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.817783    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:01.818001 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:01.817875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:01.818001 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:01.817926    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:02:01.818001 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:01.817987    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:01.818137 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:01.817990    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:02:05.817974427 +0000 UTC m=+270.083688525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : configmap "kube-rbac-proxy" not found
Jul 27 21:02:01.818137 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:01.818048    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:02:05.818032169 +0000 UTC m=+270.083746266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:02.076394 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:02.076301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4" event={"ID":"046f1083-be24-4088-976b-a05755298096","Type":"ContainerStarted","Data":"fdd6e0aeb126f41ab7df4f453b5b96df3dcfdc0dc12a6be5c0f812ee5a5e1dd5"}
Jul 27 21:02:02.076394 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:02.076361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4" event={"ID":"046f1083-be24-4088-976b-a05755298096","Type":"ContainerStarted","Data":"219ddf74dfa8d9b24ad6a4bc20c2e18b7651873376540f358e90d942fbce6dc5"}
Jul 27 21:02:02.087746 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:02.087720    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vk6qw_ef009756-bf54-4db9-9643-5d8893ad5662/serve-healthcheck-canary/0.log"
Jul 27 21:02:02.118844 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:02.116320    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-vjqx4" podStartSLOduration=2.116302378 podStartE2EDuration="2.116302378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:02.11372336 +0000 UTC m=+266.379437508" watchObservedRunningTime="2026-07-27 21:02:02.116302378 +0000 UTC m=+266.382016498"
Jul 27 21:02:05.852315 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:05.852284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:05.852713 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:05.852354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:05.852713 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:05.852422    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 21:02:05.852713 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:05.852459    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:05.852713 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:05.852494    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:02:13.852478711 +0000 UTC m=+278.118192806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : configmap "kube-rbac-proxy" not found
Jul 27 21:02:05.852713 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:05.852524    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls podName:56ea3acb-af3f-4e01-9b2c-4116b20cccfa nodeName:}" failed. No retries permitted until 2026-07-27 21:02:13.852510108 +0000 UTC m=+278.118224204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dkn4" (UID: "56ea3acb-af3f-4e01-9b2c-4116b20cccfa") : secret "insights-runtime-extractor-tls" not found
Jul 27 21:02:09.581526 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:09.581485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:02:09.583940 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:09.583919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"image-registry-578f8d645c-2qc9f\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") " pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:02:09.644977 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:09.644947    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:02:09.781434 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:09.781277    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-578f8d645c-2qc9f"]
Jul 27 21:02:09.783964 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:09.783937    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b40caad_9840_4418_9022_744b7042184d.slice/crio-36f2d9b20cd8eb19203934434ab78f651a51c37e84a6879304ef65b92034523b WatchSource:0}: Error finding container 36f2d9b20cd8eb19203934434ab78f651a51c37e84a6879304ef65b92034523b: Status 404 returned error can't find the container with id 36f2d9b20cd8eb19203934434ab78f651a51c37e84a6879304ef65b92034523b
Jul 27 21:02:10.103488 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:10.103399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f" event={"ID":"2b40caad-9840-4418-9022-744b7042184d","Type":"ContainerStarted","Data":"df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5"}
Jul 27 21:02:10.103488 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:10.103466    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f" event={"ID":"2b40caad-9840-4418-9022-744b7042184d","Type":"ContainerStarted","Data":"36f2d9b20cd8eb19203934434ab78f651a51c37e84a6879304ef65b92034523b"}
Jul 27 21:02:10.103685 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:10.103539    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:02:10.120058 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:10.120001    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f" podStartSLOduration=17.119980913 podStartE2EDuration="17.119980913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:10.119115381 +0000 UTC m=+274.384829512" watchObservedRunningTime="2026-07-27 21:02:10.119980913 +0000 UTC m=+274.385695032"
Jul 27 21:02:13.917644 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:13.917608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:13.918004 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:13.917667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:13.918229 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:13.918194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:13.920390 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:13.920359    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ea3acb-af3f-4e01-9b2c-4116b20cccfa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dkn4\" (UID: \"56ea3acb-af3f-4e01-9b2c-4116b20cccfa\") " pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:14.010279 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:14.010253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dkn4"
Jul 27 21:02:14.132530 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:14.132500    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9dkn4"]
Jul 27 21:02:14.135643 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:14.135620    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ea3acb_af3f_4e01_9b2c_4116b20cccfa.slice/crio-355bac41b9760f78b2fb12204bdcde4e2b815bff601288f12fbcab5417b65959 WatchSource:0}: Error finding container 355bac41b9760f78b2fb12204bdcde4e2b815bff601288f12fbcab5417b65959: Status 404 returned error can't find the container with id 355bac41b9760f78b2fb12204bdcde4e2b815bff601288f12fbcab5417b65959
Jul 27 21:02:15.119696 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:15.119661    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dkn4" event={"ID":"56ea3acb-af3f-4e01-9b2c-4116b20cccfa","Type":"ContainerStarted","Data":"355bac41b9760f78b2fb12204bdcde4e2b815bff601288f12fbcab5417b65959"}
Jul 27 21:02:18.776685 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:18.776644    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dc4bz" podUID="e2fab966-db3e-4b31-b267-86a540c056d1"
Jul 27 21:02:19.135078 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:19.135049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dkn4" event={"ID":"56ea3acb-af3f-4e01-9b2c-4116b20cccfa","Type":"ContainerStarted","Data":"8c90e169db56791165eaa97d93663dffb6a1ac5b51a79dc5513fcbfee7128893"}
Jul 27 21:02:19.135078 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:19.135066    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dc4bz"
Jul 27 21:02:21.871881 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.871846    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"]
Jul 27 21:02:21.873992 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.873972    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"
Jul 27 21:02:21.877508 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.877487    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-989v9\""
Jul 27 21:02:21.878581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.878563    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 21:02:21.881020 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.880989    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-578f8d645c-2qc9f"]
Jul 27 21:02:21.886949 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.886922    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-lftcb"]
Jul 27 21:02:21.889330 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.889308    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"]
Jul 27 21:02:21.889420 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.889402    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-lftcb"
Jul 27 21:02:21.891680 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.891659    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 21:02:21.891768 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.891698    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 21:02:21.891768 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.891669    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zgwlk\""
Jul 27 21:02:21.903239 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.903198    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-lftcb"]
Jul 27 21:02:21.919658 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.919636    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dbcbd47d7-6jhxh"]
Jul 27 21:02:21.922006 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.921977    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:21.937074 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.937047    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dbcbd47d7-6jhxh"]
Jul 27 21:02:21.973547 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-registry-tls\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:21.973759 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/220f5a81-a8f0-4581-a3c5-cab8a5480e85-image-registry-private-configuration\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:21.973759 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/220f5a81-a8f0-4581-a3c5-cab8a5480e85-registry-certificates\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:21.973759 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/220f5a81-a8f0-4581-a3c5-cab8a5480e85-ca-trust-extracted\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:21.973759 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-bound-sa-token\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:21.973759 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/220f5a81-a8f0-4581-a3c5-cab8a5480e85-installation-pull-secrets\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:21.974011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txlcl\" (UniqueName: \"kubernetes.io/projected/423da2d3-f363-4e67-8326-6a07a8ce41f2-kube-api-access-txlcl\") pod \"downloads-7c97dc4555-lftcb\" (UID: \"423da2d3-f363-4e67-8326-6a07a8ce41f2\") " pod="openshift-console/downloads-7c97dc4555-lftcb"
Jul 27 21:02:21.974011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b407d69-31e6-4a21-9d48-2062496802a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-c5xrb\" (UID: \"5b407d69-31e6-4a21-9d48-2062496802a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"
Jul 27 21:02:21.974011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prtbn\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-kube-api-access-prtbn\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:21.974011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:21.973984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/220f5a81-a8f0-4581-a3c5-cab8a5480e85-trusted-ca\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.075128 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-registry-tls\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.075332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/220f5a81-a8f0-4581-a3c5-cab8a5480e85-image-registry-private-configuration\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.075332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/220f5a81-a8f0-4581-a3c5-cab8a5480e85-registry-certificates\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.075332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/220f5a81-a8f0-4581-a3c5-cab8a5480e85-ca-trust-extracted\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.075332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-bound-sa-token\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.075332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/220f5a81-a8f0-4581-a3c5-cab8a5480e85-installation-pull-secrets\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.075332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 21:02:22.075627 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txlcl\" (UniqueName: \"kubernetes.io/projected/423da2d3-f363-4e67-8326-6a07a8ce41f2-kube-api-access-txlcl\") pod \"downloads-7c97dc4555-lftcb\" (UID: \"423da2d3-f363-4e67-8326-6a07a8ce41f2\") " pod="openshift-console/downloads-7c97dc4555-lftcb"
Jul 27 21:02:22.075627 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b407d69-31e6-4a21-9d48-2062496802a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-c5xrb\" (UID: \"5b407d69-31e6-4a21-9d48-2062496802a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"
Jul 27 21:02:22.075627 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prtbn\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-kube-api-access-prtbn\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.075627 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/220f5a81-a8f0-4581-a3c5-cab8a5480e85-trusted-ca\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.076395 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.075884    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/220f5a81-a8f0-4581-a3c5-cab8a5480e85-ca-trust-extracted\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.076395 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.076265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/220f5a81-a8f0-4581-a3c5-cab8a5480e85-registry-certificates\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.076603 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.076577    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/220f5a81-a8f0-4581-a3c5-cab8a5480e85-trusted-ca\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.078304 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.078254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-registry-tls\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.078468 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.078439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/220f5a81-a8f0-4581-a3c5-cab8a5480e85-image-registry-private-configuration\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.078570 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.078494    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2fab966-db3e-4b31-b267-86a540c056d1-metrics-tls\") pod \"dns-default-dc4bz\" (UID: \"e2fab966-db3e-4b31-b267-86a540c056d1\") " pod="openshift-dns/dns-default-dc4bz"
Jul 27 21:02:22.079108 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.079090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5b407d69-31e6-4a21-9d48-2062496802a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-c5xrb\" (UID: \"5b407d69-31e6-4a21-9d48-2062496802a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"
Jul 27 21:02:22.079195 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.079144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/220f5a81-a8f0-4581-a3c5-cab8a5480e85-installation-pull-secrets\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.084508 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.084490    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prtbn\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-kube-api-access-prtbn\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.084810 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.084794    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/220f5a81-a8f0-4581-a3c5-cab8a5480e85-bound-sa-token\") pod \"image-registry-dbcbd47d7-6jhxh\" (UID: \"220f5a81-a8f0-4581-a3c5-cab8a5480e85\") " pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.085205 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.085174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txlcl\" (UniqueName: \"kubernetes.io/projected/423da2d3-f363-4e67-8326-6a07a8ce41f2-kube-api-access-txlcl\") pod \"downloads-7c97dc4555-lftcb\" (UID: \"423da2d3-f363-4e67-8326-6a07a8ce41f2\") " pod="openshift-console/downloads-7c97dc4555-lftcb"
Jul 27 21:02:22.138295 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.138205    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvklp\""
Jul 27 21:02:22.146124 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.146088    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dc4bz"
Jul 27 21:02:22.184657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.184628    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"
Jul 27 21:02:22.199328 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.199305    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-lftcb"
Jul 27 21:02:22.234197 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.234145    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:22.706078 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.706047    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-lftcb"]
Jul 27 21:02:22.710267 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:22.710245    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423da2d3_f363_4e67_8326_6a07a8ce41f2.slice/crio-df6152858d5eaf6c2f367a30fb25dae9791c127ecf0bde49af497a5405122b97 WatchSource:0}: Error finding container df6152858d5eaf6c2f367a30fb25dae9791c127ecf0bde49af497a5405122b97: Status 404 returned error can't find the container with id df6152858d5eaf6c2f367a30fb25dae9791c127ecf0bde49af497a5405122b97
Jul 27 21:02:22.751763 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.751739    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dbcbd47d7-6jhxh"]
Jul 27 21:02:22.754123 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:22.754097    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220f5a81_a8f0_4581_a3c5_cab8a5480e85.slice/crio-7a8405ee3aad3207c930a29505390779a16a968fd8203654ba18f354bdd522de WatchSource:0}: Error finding container 7a8405ee3aad3207c930a29505390779a16a968fd8203654ba18f354bdd522de: Status 404 returned error can't find the container with id 7a8405ee3aad3207c930a29505390779a16a968fd8203654ba18f354bdd522de
Jul 27 21:02:22.925069 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.925041    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"]
Jul 27 21:02:22.926946 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:22.926921    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dc4bz"]
Jul 27 21:02:22.928285 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:22.928260    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b407d69_31e6_4a21_9d48_2062496802a6.slice/crio-0984be95309a1fb83e2b29aa5c6934a6c886a2c6a4e2ce22085d7a1ab11065e5 WatchSource:0}: Error finding container 0984be95309a1fb83e2b29aa5c6934a6c886a2c6a4e2ce22085d7a1ab11065e5: Status 404 returned error can't find the container with id 0984be95309a1fb83e2b29aa5c6934a6c886a2c6a4e2ce22085d7a1ab11065e5
Jul 27 21:02:22.930000 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:22.929972    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2fab966_db3e_4b31_b267_86a540c056d1.slice/crio-2755ac428d91f6a89f92d023e350c1fc4178f85be8d60c361d3a21fdbbd91419 WatchSource:0}: Error finding container 2755ac428d91f6a89f92d023e350c1fc4178f85be8d60c361d3a21fdbbd91419: Status 404 returned error can't find the container with id 2755ac428d91f6a89f92d023e350c1fc4178f85be8d60c361d3a21fdbbd91419
Jul 27 21:02:23.150642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:23.150557    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb" event={"ID":"5b407d69-31e6-4a21-9d48-2062496802a6","Type":"ContainerStarted","Data":"0984be95309a1fb83e2b29aa5c6934a6c886a2c6a4e2ce22085d7a1ab11065e5"}
Jul 27 21:02:23.152085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:23.152053    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-lftcb" event={"ID":"423da2d3-f363-4e67-8326-6a07a8ce41f2","Type":"ContainerStarted","Data":"df6152858d5eaf6c2f367a30fb25dae9791c127ecf0bde49af497a5405122b97"}
Jul 27 21:02:23.153655 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:23.153630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh" event={"ID":"220f5a81-a8f0-4581-a3c5-cab8a5480e85","Type":"ContainerStarted","Data":"092d2579351fddfc1c109a15cd49e31c39050a233185d494e679b12406f97bee"}
Jul 27 21:02:23.153777 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:23.153674    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh" event={"ID":"220f5a81-a8f0-4581-a3c5-cab8a5480e85","Type":"ContainerStarted","Data":"7a8405ee3aad3207c930a29505390779a16a968fd8203654ba18f354bdd522de"}
Jul 27 21:02:23.154088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:23.154035    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:23.155946 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:23.155917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dkn4" event={"ID":"56ea3acb-af3f-4e01-9b2c-4116b20cccfa","Type":"ContainerStarted","Data":"ed5f130601bbe3622fb2e569f894b8a9c1308a14fa7469b880e21993e1d8f9dc"}
Jul 27 21:02:23.157634 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:23.157608    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dc4bz" event={"ID":"e2fab966-db3e-4b31-b267-86a540c056d1","Type":"ContainerStarted","Data":"2755ac428d91f6a89f92d023e350c1fc4178f85be8d60c361d3a21fdbbd91419"}
Jul 27 21:02:23.173364 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:23.173258    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh" podStartSLOduration=2.173239253 podStartE2EDuration="2.173239253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:23.172185905 +0000 UTC m=+287.437900021" watchObservedRunningTime="2026-07-27 21:02:23.173239253 +0000 UTC m=+287.438953366"
Jul 27 21:02:25.171166 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:25.170539    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb" event={"ID":"5b407d69-31e6-4a21-9d48-2062496802a6","Type":"ContainerStarted","Data":"35e7fb9c48d2d374481cab4cfec3ab3812d84f7f1364bee2d319b7ea29cd55c0"}
Jul 27 21:02:25.171166 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:25.171125    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"
Jul 27 21:02:25.177161 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:25.177120    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb"
Jul 27 21:02:25.187733 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:25.187679    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c5xrb" podStartSLOduration=2.459682097 podStartE2EDuration="4.187660677s" totalImagesPullingTime="1.72797858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:25.187033026 +0000 UTC m=+289.452747147" watchObservedRunningTime="2026-07-27 21:02:25.187660677 +0000 UTC m=+289.453374797"
Jul 27 21:02:28.184668 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:28.184631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dkn4" event={"ID":"56ea3acb-af3f-4e01-9b2c-4116b20cccfa","Type":"ContainerStarted","Data":"d584cef74cab7dbf9738dec4e68483afc0bfb2504890119eac5fce39de641abf"}
Jul 27 21:02:28.186362 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:28.186336    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dc4bz" event={"ID":"e2fab966-db3e-4b31-b267-86a540c056d1","Type":"ContainerStarted","Data":"a794c91257f17de178433b481c2e0c8787401783631e5135e3f2997388625e63"}
Jul 27 21:02:28.186452 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:28.186384    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dc4bz" event={"ID":"e2fab966-db3e-4b31-b267-86a540c056d1","Type":"ContainerStarted","Data":"77b1786df84fdb78596968159bb3b6baeb01fe6ae35a37afcacc453d66d19afa"}
Jul 27 21:02:28.186452 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:28.186407    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dc4bz"
Jul 27 21:02:28.203133 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:28.203088    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9dkn4" podStartSLOduration=17.245210265 podStartE2EDuration="30.203077223s" totalImagesPullingTime="12.957866958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:01:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:28.201368667 +0000 UTC m=+292.467082786" watchObservedRunningTime="2026-07-27 21:02:28.203077223 +0000 UTC m=+292.468791341"
Jul 27 21:02:28.217742 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:28.217697    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dc4bz" podStartSLOduration=251.939784805 podStartE2EDuration="4m16.217681268s" totalImagesPullingTime="4.277896463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:28.216551354 +0000 UTC m=+292.482265482" watchObservedRunningTime="2026-07-27 21:02:28.217681268 +0000 UTC m=+292.483395367"
Jul 27 21:02:30.211279 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.211247    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9x2hq"]
Jul 27 21:02:30.221993 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.221965    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.227874 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.227720    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 21:02:30.227874 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.227720    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 21:02:30.227874 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.227750    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 21:02:30.227874 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.227820    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 21:02:30.235632 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.229073    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 21:02:30.235632 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.229402    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 21:02:30.235632 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.229619    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-28jhl\""
Jul 27 21:02:30.252599 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252571    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d39b1fca-da44-4630-855e-078d40794641-node-exporter-accelerators-collector-config\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.252732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-root\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.252732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-sys\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.252732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.252732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d39b1fca-da44-4630-855e-078d40794641-node-exporter-textfile\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.252943 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-tls\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.252943 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252819    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-node-exporter-wtmp\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.252943 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h7tf\" (UniqueName: \"kubernetes.io/projected/d39b1fca-da44-4630-855e-078d40794641-kube-api-access-5h7tf\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.252943 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.252927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d39b1fca-da44-4630-855e-078d40794641-metrics-client-ca\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.353783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.353753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-node-exporter-wtmp\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.353941 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.353811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h7tf\" (UniqueName: \"kubernetes.io/projected/d39b1fca-da44-4630-855e-078d40794641-kube-api-access-5h7tf\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.353941 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.353854    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d39b1fca-da44-4630-855e-078d40794641-metrics-client-ca\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.353941 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.353890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d39b1fca-da44-4630-855e-078d40794641-node-exporter-accelerators-collector-config\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.353941 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.353919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-root\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.353941 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.353943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-sys\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.354202 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.353952    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-node-exporter-wtmp\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.354202 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.353965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.354202 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.354014    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d39b1fca-da44-4630-855e-078d40794641-node-exporter-textfile\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.354202 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.354045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-tls\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.354202 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:30.354177    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 21:02:30.354499 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:30.354261    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-tls podName:d39b1fca-da44-4630-855e-078d40794641 nodeName:}" failed. No retries permitted until 2026-07-27 21:02:30.854241288 +0000 UTC m=+295.119955388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-tls") pod "node-exporter-9x2hq" (UID: "d39b1fca-da44-4630-855e-078d40794641") : secret "node-exporter-tls" not found
Jul 27 21:02:30.354564 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.354488    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d39b1fca-da44-4630-855e-078d40794641-node-exporter-textfile\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.355006 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.354631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-root\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.355006 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.354651    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39b1fca-da44-4630-855e-078d40794641-sys\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.355006 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.354939    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d39b1fca-da44-4630-855e-078d40794641-node-exporter-accelerators-collector-config\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.355254 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.355056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d39b1fca-da44-4630-855e-078d40794641-metrics-client-ca\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.358548 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.358504    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.363421 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.363382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h7tf\" (UniqueName: \"kubernetes.io/projected/d39b1fca-da44-4630-855e-078d40794641-kube-api-access-5h7tf\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.858501 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.858459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-tls\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:30.861434 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:30.861407    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d39b1fca-da44-4630-855e-078d40794641-node-exporter-tls\") pod \"node-exporter-9x2hq\" (UID: \"d39b1fca-da44-4630-855e-078d40794641\") " pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:31.140008 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:31.139923    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9x2hq"
Jul 27 21:02:31.150851 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:31.150822    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39b1fca_da44_4630_855e_078d40794641.slice/crio-5d4f2ed86c0e149257c2facbdb07a4235aaf794bfcbba9092e78cc72d611d1b0 WatchSource:0}: Error finding container 5d4f2ed86c0e149257c2facbdb07a4235aaf794bfcbba9092e78cc72d611d1b0: Status 404 returned error can't find the container with id 5d4f2ed86c0e149257c2facbdb07a4235aaf794bfcbba9092e78cc72d611d1b0
Jul 27 21:02:31.202301 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:31.202252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9x2hq" event={"ID":"d39b1fca-da44-4630-855e-078d40794641","Type":"ContainerStarted","Data":"5d4f2ed86c0e149257c2facbdb07a4235aaf794bfcbba9092e78cc72d611d1b0"}
Jul 27 21:02:31.273062 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:31.273011    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mqsw2" podUID="2ee7da33-7e2e-4467-b6d6-54f885d4d067"
Jul 27 21:02:31.888939 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:31.888643    2575 patch_prober.go:28] interesting pod/image-registry-578f8d645c-2qc9f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 21:02:31.888939 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:31.888718    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f" podUID="2b40caad-9840-4418-9022-744b7042184d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:02:32.455676 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.455649    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5598f78d-hmch5"]
Jul 27 21:02:32.458583 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.458564    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.463711 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.463689    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 21:02:32.463819 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.463735    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 21:02:32.463819 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.463694    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5x9c\""
Jul 27 21:02:32.464446 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.464319    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 21:02:32.464446 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.464407    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 21:02:32.464643 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.464538    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 21:02:32.469070 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.469051    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 21:02:32.469707 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.469686    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5598f78d-hmch5"]
Jul 27 21:02:32.572734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.572664    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-service-ca\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.572734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.572698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86ksq\" (UniqueName: \"kubernetes.io/projected/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-kube-api-access-86ksq\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.572734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.572717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-config\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.572734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.572735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-serving-cert\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.573011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.572754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-oauth-config\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.573011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.572840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-oauth-serving-cert\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.573011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.572889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-trusted-ca-bundle\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.673990 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.673955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-oauth-serving-cert\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.674164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.674003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-trusted-ca-bundle\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.674164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.674050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-service-ca\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.674164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.674078    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86ksq\" (UniqueName: \"kubernetes.io/projected/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-kube-api-access-86ksq\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.674164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.674103    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-config\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.674164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.674127    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-serving-cert\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.674164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.674157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-oauth-config\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.674991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.674831    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-oauth-serving-cert\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.674991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.674956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-service-ca\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.675241 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.675155    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-trusted-ca-bundle\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.675241 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.675187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-config\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.676972 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.676951    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-serving-cert\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.677202 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.677181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-oauth-config\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.681431 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.681412    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86ksq\" (UniqueName: \"kubernetes.io/projected/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-kube-api-access-86ksq\") pod \"console-5598f78d-hmch5\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") " pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.796501 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.796466    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:32.938845 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:32.938811    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5598f78d-hmch5"]
Jul 27 21:02:32.942230 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:02:32.942186    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21ee9fe_69ac_494f_aaf0_9fdfc1414d85.slice/crio-9096296db0072386ca89c79bb4944e539918ca5eea37bc2d65ccf252e370e9e1 WatchSource:0}: Error finding container 9096296db0072386ca89c79bb4944e539918ca5eea37bc2d65ccf252e370e9e1: Status 404 returned error can't find the container with id 9096296db0072386ca89c79bb4944e539918ca5eea37bc2d65ccf252e370e9e1
Jul 27 21:02:33.211702 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:33.211611    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5598f78d-hmch5" event={"ID":"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85","Type":"ContainerStarted","Data":"9096296db0072386ca89c79bb4944e539918ca5eea37bc2d65ccf252e370e9e1"}
Jul 27 21:02:33.213524 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:33.213425    2575 generic.go:356] "Generic (PLEG): container finished" podID="d39b1fca-da44-4630-855e-078d40794641" containerID="d77cbfbdc6716d6f5bdaa0a1db0adf5ff1d4a24394896cc92ec686a8278cef34" exitCode=0
Jul 27 21:02:33.213524 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:33.213479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9x2hq" event={"ID":"d39b1fca-da44-4630-855e-078d40794641","Type":"ContainerDied","Data":"d77cbfbdc6716d6f5bdaa0a1db0adf5ff1d4a24394896cc92ec686a8278cef34"}
Jul 27 21:02:34.220952 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:34.220917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9x2hq" event={"ID":"d39b1fca-da44-4630-855e-078d40794641","Type":"ContainerStarted","Data":"66469cc21ac9c53ccdeac9778115864ffdf3126563b50afb267345d249486750"}
Jul 27 21:02:34.221428 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:34.220982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9x2hq" event={"ID":"d39b1fca-da44-4630-855e-078d40794641","Type":"ContainerStarted","Data":"74721724633b351c1f4c19ba74ca10b1867113816298c209ac554aaa9e4ef23a"}
Jul 27 21:02:34.239524 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:34.238690    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9x2hq" podStartSLOduration=3.017301614 podStartE2EDuration="4.238676286s" totalImagesPullingTime="1.146877081s" totalInitContainerRuntime="74.497591ms" isStatefulPod=true podCreationTimestamp="2026-07-27 21:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:34.237136294 +0000 UTC m=+298.502850426" watchObservedRunningTime="2026-07-27 21:02:34.238676286 +0000 UTC m=+298.504390405"
Jul 27 21:02:38.192673 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:38.192641    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dc4bz"
Jul 27 21:02:41.886300 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:41.886266    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:02:42.239123 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:42.239088    2575 patch_prober.go:28] interesting pod/image-registry-dbcbd47d7-6jhxh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 21:02:42.239323 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:42.239150    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh" podUID="220f5a81-a8f0-4581-a3c5-cab8a5480e85" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:02:42.253881 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:42.253851    2575 generic.go:356] "Generic (PLEG): container finished" podID="a47c7a1b-f0ca-4312-bc36-8be87577c7fa" containerID="2a6c1f5d61b1a9376849a404652a83e2cf5d6d4fc8f3d06367947f548713f144" exitCode=255
Jul 27 21:02:42.254024 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:42.253929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" event={"ID":"a47c7a1b-f0ca-4312-bc36-8be87577c7fa","Type":"ContainerDied","Data":"2a6c1f5d61b1a9376849a404652a83e2cf5d6d4fc8f3d06367947f548713f144"}
Jul 27 21:02:42.254024 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:42.253995    2575 scope.go:117] "RemoveContainer" containerID="406f17d10e4f7f6188679458fb0cd25d25233662704a5682ef58a87803f3d61f"
Jul 27 21:02:42.262016 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:42.261999    2575 scope.go:117] "RemoveContainer" containerID="2a6c1f5d61b1a9376849a404652a83e2cf5d6d4fc8f3d06367947f548713f144"
Jul 27 21:02:42.262221 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:42.262189    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5df5f789b4-6prts_open-cluster-management-agent-addon(a47c7a1b-f0ca-4312-bc36-8be87577c7fa)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" podUID="a47c7a1b-f0ca-4312-bc36-8be87577c7fa"
Jul 27 21:02:42.271367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:42.271308    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 21:02:42.853035 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:42.852999    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" podUID="d3b73a30-967d-4afa-b25e-486a336be2ef" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
Jul 27 21:02:43.178561 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:43.178543    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 21:02:43.261054 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:43.261023    2575 generic.go:356] "Generic (PLEG): container finished" podID="d3b73a30-967d-4afa-b25e-486a336be2ef" containerID="6262f8aafbb4327e583ba424696606de20a5ea178e68b6e6591b5309e7b87073" exitCode=1
Jul 27 21:02:43.261161 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:43.261070    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" event={"ID":"d3b73a30-967d-4afa-b25e-486a336be2ef","Type":"ContainerDied","Data":"6262f8aafbb4327e583ba424696606de20a5ea178e68b6e6591b5309e7b87073"}
Jul 27 21:02:43.261161 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:43.261144    2575 scope.go:117] "RemoveContainer" containerID="a13e208994e22149ac8ba73745e4f31e4e2e7fe4e053ad074cd72abc64d0f5e6"
Jul 27 21:02:43.261465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:43.261449    2575 scope.go:117] "RemoveContainer" containerID="6262f8aafbb4327e583ba424696606de20a5ea178e68b6e6591b5309e7b87073"
Jul 27 21:02:43.261652 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:43.261633    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7648676769-684qk_open-cluster-management-agent-addon(d3b73a30-967d-4afa-b25e-486a336be2ef)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" podUID="d3b73a30-967d-4afa-b25e-486a336be2ef"
Jul 27 21:02:44.168189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:44.168152    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dbcbd47d7-6jhxh"
Jul 27 21:02:44.269544 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:44.269511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5598f78d-hmch5" event={"ID":"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85","Type":"ContainerStarted","Data":"569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6"}
Jul 27 21:02:44.276879 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:44.276859    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-lftcb"
Jul 27 21:02:44.277014 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:44.276903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-lftcb" event={"ID":"423da2d3-f363-4e67-8326-6a07a8ce41f2","Type":"ContainerStarted","Data":"0854f3027e0b01486f5189aa116624ea8f772b59e94d240405422c9aabcf1cb5"}
Jul 27 21:02:44.290662 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:44.290639    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-lftcb"
Jul 27 21:02:44.299085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:44.299003    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5598f78d-hmch5" podStartSLOduration=2.08746987 podStartE2EDuration="12.298985044s" totalImagesPullingTime="10.211515174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:44.297787583 +0000 UTC m=+308.563501701" watchObservedRunningTime="2026-07-27 21:02:44.298985044 +0000 UTC m=+308.564699164"
Jul 27 21:02:44.322423 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:44.322372    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-lftcb" podStartSLOduration=2.848478469 podStartE2EDuration="23.322352893s" totalImagesPullingTime="20.473874424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:02:44.321458276 +0000 UTC m=+308.587172394" watchObservedRunningTime="2026-07-27 21:02:44.322352893 +0000 UTC m=+308.588067012"
Jul 27 21:02:45.542579 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:45.542539    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5598f78d-hmch5"]
Jul 27 21:02:46.903427 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:46.903376    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f" podUID="2b40caad-9840-4418-9022-744b7042184d" containerName="registry" containerID="cri-o://df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5" gracePeriod=30
Jul 27 21:02:47.014326 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.014299    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts"
Jul 27 21:02:47.014677 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.014654    2575 scope.go:117] "RemoveContainer" containerID="2a6c1f5d61b1a9376849a404652a83e2cf5d6d4fc8f3d06367947f548713f144"
Jul 27 21:02:47.014899 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:47.014875    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5df5f789b4-6prts_open-cluster-management-agent-addon(a47c7a1b-f0ca-4312-bc36-8be87577c7fa)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" podUID="a47c7a1b-f0ca-4312-bc36-8be87577c7fa"
Jul 27 21:02:47.020577 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.020553    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 21:02:47.020893 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.020875    2575 scope.go:117] "RemoveContainer" containerID="6262f8aafbb4327e583ba424696606de20a5ea178e68b6e6591b5309e7b87073"
Jul 27 21:02:47.021031 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:47.021011    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7648676769-684qk_open-cluster-management-agent-addon(d3b73a30-967d-4afa-b25e-486a336be2ef)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" podUID="d3b73a30-967d-4afa-b25e-486a336be2ef"
Jul 27 21:02:47.220708 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.220678    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:02:47.286188 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.286157    2575 generic.go:356] "Generic (PLEG): container finished" podID="2b40caad-9840-4418-9022-744b7042184d" containerID="df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5" exitCode=0
Jul 27 21:02:47.286380 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.286276    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f" event={"ID":"2b40caad-9840-4418-9022-744b7042184d","Type":"ContainerDied","Data":"df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5"}
Jul 27 21:02:47.286380 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.286312    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f" event={"ID":"2b40caad-9840-4418-9022-744b7042184d","Type":"ContainerDied","Data":"36f2d9b20cd8eb19203934434ab78f651a51c37e84a6879304ef65b92034523b"}
Jul 27 21:02:47.286380 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.286336    2575 scope.go:117] "RemoveContainer" containerID="df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5"
Jul 27 21:02:47.286526 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.286464    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578f8d645c-2qc9f"
Jul 27 21:02:47.295505 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.295483    2575 scope.go:117] "RemoveContainer" containerID="df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5"
Jul 27 21:02:47.295807 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:02:47.295780    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5\": container with ID starting with df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5 not found: ID does not exist" containerID="df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5"
Jul 27 21:02:47.295898 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.295816    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5"} err="failed to get container status \"df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5\": rpc error: code = NotFound desc = could not find container \"df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5\": container with ID starting with df3bec1a58074e94a9682a8d724becbb98d681c3f50264e29fa72cac06f9dcf5 not found: ID does not exist"
Jul 27 21:02:47.316269 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316244    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-trusted-ca\") pod \"2b40caad-9840-4418-9022-744b7042184d\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") "
Jul 27 21:02:47.316379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316297    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") pod \"2b40caad-9840-4418-9022-744b7042184d\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") "
Jul 27 21:02:47.316379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316330    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b40caad-9840-4418-9022-744b7042184d-ca-trust-extracted\") pod \"2b40caad-9840-4418-9022-744b7042184d\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") "
Jul 27 21:02:47.316597 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316568    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-installation-pull-secrets\") pod \"2b40caad-9840-4418-9022-744b7042184d\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") "
Jul 27 21:02:47.316708 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316629    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-image-registry-private-configuration\") pod \"2b40caad-9840-4418-9022-744b7042184d\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") "
Jul 27 21:02:47.316708 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2b40caad-9840-4418-9022-744b7042184d" (UID: "2b40caad-9840-4418-9022-744b7042184d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:02:47.316708 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316686    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-registry-certificates\") pod \"2b40caad-9840-4418-9022-744b7042184d\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") "
Jul 27 21:02:47.316869 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316728    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl9bv\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-kube-api-access-rl9bv\") pod \"2b40caad-9840-4418-9022-744b7042184d\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") "
Jul 27 21:02:47.316869 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316759    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-bound-sa-token\") pod \"2b40caad-9840-4418-9022-744b7042184d\" (UID: \"2b40caad-9840-4418-9022-744b7042184d\") "
Jul 27 21:02:47.316988 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.316967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2b40caad-9840-4418-9022-744b7042184d" (UID: "2b40caad-9840-4418-9022-744b7042184d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:02:47.317047 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.317000    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-trusted-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:02:47.319609 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.319587    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2b40caad-9840-4418-9022-744b7042184d" (UID: "2b40caad-9840-4418-9022-744b7042184d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:47.319918 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.319873    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2b40caad-9840-4418-9022-744b7042184d" (UID: "2b40caad-9840-4418-9022-744b7042184d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:02:47.319918 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.319898    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2b40caad-9840-4418-9022-744b7042184d" (UID: "2b40caad-9840-4418-9022-744b7042184d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:02:47.320074 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.319935    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-kube-api-access-rl9bv" (OuterVolumeSpecName: "kube-api-access-rl9bv") pod "2b40caad-9840-4418-9022-744b7042184d" (UID: "2b40caad-9840-4418-9022-744b7042184d"). InnerVolumeSpecName "kube-api-access-rl9bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:47.321679 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.321653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2b40caad-9840-4418-9022-744b7042184d" (UID: "2b40caad-9840-4418-9022-744b7042184d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:02:47.328529 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.328504    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b40caad-9840-4418-9022-744b7042184d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2b40caad-9840-4418-9022-744b7042184d" (UID: "2b40caad-9840-4418-9022-744b7042184d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:02:47.417566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.417500    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-registry-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:02:47.417566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.417530    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b40caad-9840-4418-9022-744b7042184d-ca-trust-extracted\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:02:47.417566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.417540    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-installation-pull-secrets\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:02:47.417566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.417551    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b40caad-9840-4418-9022-744b7042184d-image-registry-private-configuration\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:02:47.417566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.417559    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b40caad-9840-4418-9022-744b7042184d-registry-certificates\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:02:47.417566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.417567    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl9bv\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-kube-api-access-rl9bv\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:02:47.417566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.417576    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b40caad-9840-4418-9022-744b7042184d-bound-sa-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:02:47.611385 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.611356    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-578f8d645c-2qc9f"]
Jul 27 21:02:47.615899 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:47.615873    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-578f8d645c-2qc9f"]
Jul 27 21:02:48.276788 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:48.276751    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b40caad-9840-4418-9022-744b7042184d" path="/var/lib/kubelet/pods/2b40caad-9840-4418-9022-744b7042184d/volumes"
Jul 27 21:02:52.797344 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:52.797303    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:02:52.852596 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:52.852572    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 21:02:52.852925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:52.852913    2575 scope.go:117] "RemoveContainer" containerID="6262f8aafbb4327e583ba424696606de20a5ea178e68b6e6591b5309e7b87073"
Jul 27 21:02:53.313228 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:53.313180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk" event={"ID":"d3b73a30-967d-4afa-b25e-486a336be2ef","Type":"ContainerStarted","Data":"2f2bd344cc94047b411c5968f6ac0839aa63c1464e96f38314cb991908055799"}
Jul 27 21:02:53.313522 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:53.313504    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 21:02:53.315036 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:53.315017    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7648676769-684qk"
Jul 27 21:02:59.279022 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:02:59.278993    2575 scope.go:117] "RemoveContainer" containerID="2a6c1f5d61b1a9376849a404652a83e2cf5d6d4fc8f3d06367947f548713f144"
Jul 27 21:03:00.337951 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:00.337915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5df5f789b4-6prts" event={"ID":"a47c7a1b-f0ca-4312-bc36-8be87577c7fa","Type":"ContainerStarted","Data":"34f106bf4e3e2508f46d7e523ca4809743d6585de6dad109dc8ec1a19171d12b"}
Jul 27 21:03:11.302961 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.302898    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5598f78d-hmch5" podUID="f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" containerName="console" containerID="cri-o://569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6" gracePeriod=15
Jul 27 21:03:11.570606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.570549    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:03:11.598885 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.598857    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-config\") pod \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") "
Jul 27 21:03:11.599000 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.598901    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-service-ca\") pod \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") "
Jul 27 21:03:11.599000 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.598930    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86ksq\" (UniqueName: \"kubernetes.io/projected/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-kube-api-access-86ksq\") pod \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") "
Jul 27 21:03:11.599000 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.598957    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-trusted-ca-bundle\") pod \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") "
Jul 27 21:03:11.599000 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.598990    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-oauth-config\") pod \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") "
Jul 27 21:03:11.599180 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.599015    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-oauth-serving-cert\") pod \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") "
Jul 27 21:03:11.599180 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.599056    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-serving-cert\") pod \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\" (UID: \"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85\") "
Jul 27 21:03:11.599378 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.599323    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-config" (OuterVolumeSpecName: "console-config") pod "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" (UID: "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:11.599583 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.599437    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-service-ca" (OuterVolumeSpecName: "service-ca") pod "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" (UID: "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:11.599666 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.599574    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" (UID: "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:11.599723 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.599685    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" (UID: "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:03:11.601585 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.601562    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-kube-api-access-86ksq" (OuterVolumeSpecName: "kube-api-access-86ksq") pod "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" (UID: "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85"). InnerVolumeSpecName "kube-api-access-86ksq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:03:11.601672 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.601559    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" (UID: "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:11.601672 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.601634    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" (UID: "f21ee9fe-69ac-494f-aaf0-9fdfc1414d85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:03:11.700140 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.700111    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-config\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:03:11.700140 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.700138    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:03:11.700345 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.700149    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86ksq\" (UniqueName: \"kubernetes.io/projected/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-kube-api-access-86ksq\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:03:11.700345 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.700159    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-trusted-ca-bundle\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:03:11.700345 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.700168    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-oauth-config\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:03:11.700345 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.700176    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-oauth-serving-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:03:11.700345 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:11.700184    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85-console-serving-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:03:12.376987 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.376959    2575 generic.go:356] "Generic (PLEG): container finished" podID="f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" containerID="569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6" exitCode=0
Jul 27 21:03:12.377434 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.377002    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5598f78d-hmch5"
Jul 27 21:03:12.377434 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.377006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5598f78d-hmch5" event={"ID":"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85","Type":"ContainerDied","Data":"569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6"}
Jul 27 21:03:12.377434 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.377041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5598f78d-hmch5" event={"ID":"f21ee9fe-69ac-494f-aaf0-9fdfc1414d85","Type":"ContainerDied","Data":"9096296db0072386ca89c79bb4944e539918ca5eea37bc2d65ccf252e370e9e1"}
Jul 27 21:03:12.377434 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.377061    2575 scope.go:117] "RemoveContainer" containerID="569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6"
Jul 27 21:03:12.384868 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.384851    2575 scope.go:117] "RemoveContainer" containerID="569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6"
Jul 27 21:03:12.385140 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:03:12.385121    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6\": container with ID starting with 569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6 not found: ID does not exist" containerID="569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6"
Jul 27 21:03:12.385232 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.385151    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6"} err="failed to get container status \"569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6\": rpc error: code = NotFound desc = could not find container \"569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6\": container with ID starting with 569a63d1fd793c15cfabd8424a81672d581fde0e0ebf1294eb79a50a65fe76a6 not found: ID does not exist"
Jul 27 21:03:12.406847 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.406829    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5598f78d-hmch5"]
Jul 27 21:03:12.418537 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:12.418518    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5598f78d-hmch5"]
Jul 27 21:03:14.275937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:14.275906    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" path="/var/lib/kubelet/pods/f21ee9fe-69ac-494f-aaf0-9fdfc1414d85/volumes"
Jul 27 21:03:23.415138 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:23.415106    2575 generic.go:356] "Generic (PLEG): container finished" podID="83f10c36-22bf-4a4f-96de-9f01ec45ad4a" containerID="8ea61633bee2eff2963cd99f0742663404d89b2b52488148b96d24cf196e61db" exitCode=0
Jul 27 21:03:23.415619 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:23.415185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc" event={"ID":"83f10c36-22bf-4a4f-96de-9f01ec45ad4a","Type":"ContainerDied","Data":"8ea61633bee2eff2963cd99f0742663404d89b2b52488148b96d24cf196e61db"}
Jul 27 21:03:23.415619 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:23.415520    2575 scope.go:117] "RemoveContainer" containerID="8ea61633bee2eff2963cd99f0742663404d89b2b52488148b96d24cf196e61db"
Jul 27 21:03:24.420248 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:24.420197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-dbkxc" event={"ID":"83f10c36-22bf-4a4f-96de-9f01ec45ad4a","Type":"ContainerStarted","Data":"083edd44a355d376e0d12ce15e3b4363bdfd116146e4d253bb78c5fb4bbadcc9"}
Jul 27 21:03:49.985331 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:49.985296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 21:03:49.987703 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:49.987673    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ee7da33-7e2e-4467-b6d6-54f885d4d067-metrics-certs\") pod \"network-metrics-daemon-mqsw2\" (UID: \"2ee7da33-7e2e-4467-b6d6-54f885d4d067\") " pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 21:03:50.074676 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:50.074649    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cxsx8\""
Jul 27 21:03:50.082088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:50.082065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqsw2"
Jul 27 21:03:50.212291 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:50.212270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mqsw2"]
Jul 27 21:03:50.214814 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:03:50.214787    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee7da33_7e2e_4467_b6d6_54f885d4d067.slice/crio-ab74949b6f92bfe5d1f35629224dd6d4d0325eb7a3112355c26912997761fb28 WatchSource:0}: Error finding container ab74949b6f92bfe5d1f35629224dd6d4d0325eb7a3112355c26912997761fb28: Status 404 returned error can't find the container with id ab74949b6f92bfe5d1f35629224dd6d4d0325eb7a3112355c26912997761fb28
Jul 27 21:03:50.216469 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:50.216443    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:03:50.513176 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:50.513141    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqsw2" event={"ID":"2ee7da33-7e2e-4467-b6d6-54f885d4d067","Type":"ContainerStarted","Data":"ab74949b6f92bfe5d1f35629224dd6d4d0325eb7a3112355c26912997761fb28"}
Jul 27 21:03:51.518142 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:51.518101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqsw2" event={"ID":"2ee7da33-7e2e-4467-b6d6-54f885d4d067","Type":"ContainerStarted","Data":"1bbfd0698ddd85230acc56e7d3bddfda9977d7479cca5eec83a8edeeb745f7ef"}
Jul 27 21:03:51.518570 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:03:51.518152    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqsw2" event={"ID":"2ee7da33-7e2e-4467-b6d6-54f885d4d067","Type":"ContainerStarted","Data":"7430bfddca322963d8fa343d5454e7b9b1c0d5fbf0cc36b44ca45e9de7461eec"}
Jul 27 21:06:47.999896 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:47.999784    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mqsw2" podStartSLOduration=551.049416008 podStartE2EDuration="9m11.999766081s" totalImagesPullingTime="950.350073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:03:51.534121695 +0000 UTC m=+375.799835814" watchObservedRunningTime="2026-07-27 21:06:47.999766081 +0000 UTC m=+552.265480234"
Jul 27 21:06:48.000789 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.000768    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vf7t7"]
Jul 27 21:06:48.001569 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.001543    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b40caad-9840-4418-9022-744b7042184d" containerName="registry"
Jul 27 21:06:48.001569 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.001571    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b40caad-9840-4418-9022-744b7042184d" containerName="registry"
Jul 27 21:06:48.001727 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.001619    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" containerName="console"
Jul 27 21:06:48.001727 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.001629    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" containerName="console"
Jul 27 21:06:48.001821 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.001785    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f21ee9fe-69ac-494f-aaf0-9fdfc1414d85" containerName="console"
Jul 27 21:06:48.001821 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.001800    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b40caad-9840-4418-9022-744b7042184d" containerName="registry"
Jul 27 21:06:48.006523 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.006497    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:48.009396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.009367    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 21:06:48.016103 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.016084    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 21:06:48.027428 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.027390    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-fplk6\""
Jul 27 21:06:48.032446 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.032423    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vf7t7"]
Jul 27 21:06:48.119142 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.119106    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa9dfcc-9adb-4c03-9e1e-26b3cef60615-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vf7t7\" (UID: \"5fa9dfcc-9adb-4c03-9e1e-26b3cef60615\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:48.119369 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.119178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7jrc\" (UniqueName: \"kubernetes.io/projected/5fa9dfcc-9adb-4c03-9e1e-26b3cef60615-kube-api-access-j7jrc\") pod \"cert-manager-webhook-6486ffd997-vf7t7\" (UID: \"5fa9dfcc-9adb-4c03-9e1e-26b3cef60615\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:48.219610 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.219576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7jrc\" (UniqueName: \"kubernetes.io/projected/5fa9dfcc-9adb-4c03-9e1e-26b3cef60615-kube-api-access-j7jrc\") pod \"cert-manager-webhook-6486ffd997-vf7t7\" (UID: \"5fa9dfcc-9adb-4c03-9e1e-26b3cef60615\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:48.219610 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.219620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa9dfcc-9adb-4c03-9e1e-26b3cef60615-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vf7t7\" (UID: \"5fa9dfcc-9adb-4c03-9e1e-26b3cef60615\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:48.229533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.229500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fa9dfcc-9adb-4c03-9e1e-26b3cef60615-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vf7t7\" (UID: \"5fa9dfcc-9adb-4c03-9e1e-26b3cef60615\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:48.231148 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.231128    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7jrc\" (UniqueName: \"kubernetes.io/projected/5fa9dfcc-9adb-4c03-9e1e-26b3cef60615-kube-api-access-j7jrc\") pod \"cert-manager-webhook-6486ffd997-vf7t7\" (UID: \"5fa9dfcc-9adb-4c03-9e1e-26b3cef60615\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:48.315979 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.315890    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:48.448054 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:48.448025    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vf7t7"]
Jul 27 21:06:48.451467 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:06:48.451432    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fa9dfcc_9adb_4c03_9e1e_26b3cef60615.slice/crio-10ec375576bbac31fc90d7f7431a5b135c7e9bdcaf54fb29fb38941fef32db77 WatchSource:0}: Error finding container 10ec375576bbac31fc90d7f7431a5b135c7e9bdcaf54fb29fb38941fef32db77: Status 404 returned error can't find the container with id 10ec375576bbac31fc90d7f7431a5b135c7e9bdcaf54fb29fb38941fef32db77
Jul 27 21:06:49.132515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:49.132458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7" event={"ID":"5fa9dfcc-9adb-4c03-9e1e-26b3cef60615","Type":"ContainerStarted","Data":"10ec375576bbac31fc90d7f7431a5b135c7e9bdcaf54fb29fb38941fef32db77"}
Jul 27 21:06:52.145758 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:52.145725    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7" event={"ID":"5fa9dfcc-9adb-4c03-9e1e-26b3cef60615","Type":"ContainerStarted","Data":"37776782925ce56f057a18efd543e0f5c78337529d583a4b1973b7ff20a5f7c5"}
Jul 27 21:06:52.146139 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:52.145850    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:06:52.162852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:52.162796    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7" podStartSLOduration=2.187444216 podStartE2EDuration="5.162780743s" totalImagesPullingTime="2.975336527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:52.161415802 +0000 UTC m=+556.427129921" watchObservedRunningTime="2026-07-27 21:06:52.162780743 +0000 UTC m=+556.428494860"
Jul 27 21:06:58.151035 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:06:58.150979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vf7t7"
Jul 27 21:07:01.578465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.578420    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"]
Jul 27 21:07:01.580387 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.580370    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"
Jul 27 21:07:01.583368 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.583345    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 21:07:01.583493 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.583428    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 21:07:01.584332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.584314    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ntq8d\""
Jul 27 21:07:01.590997 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.590977    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"]
Jul 27 21:07:01.604879 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.604846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krf4j\" (UID: \"ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"
Jul 27 21:07:01.605005 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.604925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbth6\" (UniqueName: \"kubernetes.io/projected/ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2-kube-api-access-pbth6\") pod \"openshift-lws-operator-fd8ccff4c-krf4j\" (UID: \"ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"
Jul 27 21:07:01.705937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.705904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbth6\" (UniqueName: \"kubernetes.io/projected/ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2-kube-api-access-pbth6\") pod \"openshift-lws-operator-fd8ccff4c-krf4j\" (UID: \"ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"
Jul 27 21:07:01.705937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.705952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krf4j\" (UID: \"ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"
Jul 27 21:07:01.706308 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.706292    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-krf4j\" (UID: \"ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"
Jul 27 21:07:01.717468 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.717450    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbth6\" (UniqueName: \"kubernetes.io/projected/ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2-kube-api-access-pbth6\") pod \"openshift-lws-operator-fd8ccff4c-krf4j\" (UID: \"ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"
Jul 27 21:07:01.889166 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:01.889084    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"
Jul 27 21:07:02.013568 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:02.013536    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j"]
Jul 27 21:07:02.016886 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:02.016860    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef7f0a90_cdf0_4b76_a82c_7c8db64e73f2.slice/crio-7b757d8a2f4a6a23d2d916b3751808071a0dbf6ef787c18d54477075dad87e4f WatchSource:0}: Error finding container 7b757d8a2f4a6a23d2d916b3751808071a0dbf6ef787c18d54477075dad87e4f: Status 404 returned error can't find the container with id 7b757d8a2f4a6a23d2d916b3751808071a0dbf6ef787c18d54477075dad87e4f
Jul 27 21:07:02.183693 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:02.183610    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j" event={"ID":"ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2","Type":"ContainerStarted","Data":"7b757d8a2f4a6a23d2d916b3751808071a0dbf6ef787c18d54477075dad87e4f"}
Jul 27 21:07:05.198970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:05.198936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j" event={"ID":"ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2","Type":"ContainerStarted","Data":"750d67bb2359513bbc2e7dcef6cf143b336e9662712548319ccb603faeca3709"}
Jul 27 21:07:05.215130 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:05.215082    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-krf4j" podStartSLOduration=1.532682227 podStartE2EDuration="4.215065491s" totalImagesPullingTime="2.682383264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:05.213883521 +0000 UTC m=+569.479597639" watchObservedRunningTime="2026-07-27 21:07:05.215065491 +0000 UTC m=+569.480779608"
Jul 27 21:07:21.725626 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.725593    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"]
Jul 27 21:07:21.728964 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.728946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.734270 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.734248    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 21:07:21.734640 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.734617    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 21:07:21.734884 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.734868    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 21:07:21.736867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.736849    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g5q6d\""
Jul 27 21:07:21.737166 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.737151    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 21:07:21.753341 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.753317    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"]
Jul 27 21:07:21.852384 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.852347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28f383a2-7454-46db-bc55-5fce3e7e72cb-manifests\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.852592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.852396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28f383a2-7454-46db-bc55-5fce3e7e72cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.852592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.852438    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28f383a2-7454-46db-bc55-5fce3e7e72cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.852592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.852472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f383a2-7454-46db-bc55-5fce3e7e72cb-tmp\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.852592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.852561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phszk\" (UniqueName: \"kubernetes.io/projected/28f383a2-7454-46db-bc55-5fce3e7e72cb-kube-api-access-phszk\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.953809 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.953778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28f383a2-7454-46db-bc55-5fce3e7e72cb-manifests\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.953935 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.953827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28f383a2-7454-46db-bc55-5fce3e7e72cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.953935 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.953848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28f383a2-7454-46db-bc55-5fce3e7e72cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.953935 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.953868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f383a2-7454-46db-bc55-5fce3e7e72cb-tmp\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.953935 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.953908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phszk\" (UniqueName: \"kubernetes.io/projected/28f383a2-7454-46db-bc55-5fce3e7e72cb-kube-api-access-phszk\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.954287 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.954265    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28f383a2-7454-46db-bc55-5fce3e7e72cb-manifests\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.956430 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.956404    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f383a2-7454-46db-bc55-5fce3e7e72cb-tmp\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.956592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.956576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28f383a2-7454-46db-bc55-5fce3e7e72cb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.956708 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.956686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28f383a2-7454-46db-bc55-5fce3e7e72cb-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:21.963531 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:21.963508    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phszk\" (UniqueName: \"kubernetes.io/projected/28f383a2-7454-46db-bc55-5fce3e7e72cb-kube-api-access-phszk\") pod \"opendatahub-operator-controller-manager-798cd98846-lm9cg\" (UID: \"28f383a2-7454-46db-bc55-5fce3e7e72cb\") " pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:22.038581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:22.038551    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:22.175396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:22.175364    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"]
Jul 27 21:07:22.178496 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:22.178463    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f383a2_7454_46db_bc55_5fce3e7e72cb.slice/crio-e31dffc6403e171885a9a99d853039dce4af66828c31a0247352614d8c1b0da4 WatchSource:0}: Error finding container e31dffc6403e171885a9a99d853039dce4af66828c31a0247352614d8c1b0da4: Status 404 returned error can't find the container with id e31dffc6403e171885a9a99d853039dce4af66828c31a0247352614d8c1b0da4
Jul 27 21:07:22.258313 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:22.258279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg" event={"ID":"28f383a2-7454-46db-bc55-5fce3e7e72cb","Type":"ContainerStarted","Data":"e31dffc6403e171885a9a99d853039dce4af66828c31a0247352614d8c1b0da4"}
Jul 27 21:07:26.276639 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:26.276604    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg" event={"ID":"28f383a2-7454-46db-bc55-5fce3e7e72cb","Type":"ContainerStarted","Data":"e188e8b31abf4d3faade47ef80bc64efe3bdfe1ade285f2c7bd08614e7ed63d0"}
Jul 27 21:07:27.282041 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:27.282009    2575 generic.go:356] "Generic (PLEG): container finished" podID="28f383a2-7454-46db-bc55-5fce3e7e72cb" containerID="e188e8b31abf4d3faade47ef80bc64efe3bdfe1ade285f2c7bd08614e7ed63d0" exitCode=0
Jul 27 21:07:27.282465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:27.282083    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg" event={"ID":"28f383a2-7454-46db-bc55-5fce3e7e72cb","Type":"ContainerDied","Data":"e188e8b31abf4d3faade47ef80bc64efe3bdfe1ade285f2c7bd08614e7ed63d0"}
Jul 27 21:07:28.287468 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:28.287433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg" event={"ID":"28f383a2-7454-46db-bc55-5fce3e7e72cb","Type":"ContainerStarted","Data":"8284d1af4d491516c0c375b35a1aeeabcb715bcc2697f2118e0d08d0d000cd99"}
Jul 27 21:07:28.287872 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:28.287572    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:28.311997 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:28.311949    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg" podStartSLOduration=2.390163044 podStartE2EDuration="7.311934659s" totalImagesPullingTime="3.89721918s" totalInitContainerRuntime="1.024552435s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:28.311335384 +0000 UTC m=+592.577049502" watchObservedRunningTime="2026-07-27 21:07:28.311934659 +0000 UTC m=+592.577648778"
Jul 27 21:07:39.293925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:39.293894    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-798cd98846-lm9cg"
Jul 27 21:07:41.423433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.423405    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ztqhj"]
Jul 27 21:07:41.425758 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.425743    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:41.427987 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.427956    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 21:07:41.430572 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.430556    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-24fhb\""
Jul 27 21:07:41.442079 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.442049    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ztqhj"]
Jul 27 21:07:41.508005 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.507973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6da9e7e-2f57-4baa-a635-2ac347e076f4-cert\") pod \"odh-model-controller-7998c67dc4-ztqhj\" (UID: \"f6da9e7e-2f57-4baa-a635-2ac347e076f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:41.508161 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.508012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h972l\" (UniqueName: \"kubernetes.io/projected/f6da9e7e-2f57-4baa-a635-2ac347e076f4-kube-api-access-h972l\") pod \"odh-model-controller-7998c67dc4-ztqhj\" (UID: \"f6da9e7e-2f57-4baa-a635-2ac347e076f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:41.608719 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.608689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6da9e7e-2f57-4baa-a635-2ac347e076f4-cert\") pod \"odh-model-controller-7998c67dc4-ztqhj\" (UID: \"f6da9e7e-2f57-4baa-a635-2ac347e076f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:41.608897 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.608727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h972l\" (UniqueName: \"kubernetes.io/projected/f6da9e7e-2f57-4baa-a635-2ac347e076f4-kube-api-access-h972l\") pod \"odh-model-controller-7998c67dc4-ztqhj\" (UID: \"f6da9e7e-2f57-4baa-a635-2ac347e076f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:41.611182 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.611158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6da9e7e-2f57-4baa-a635-2ac347e076f4-cert\") pod \"odh-model-controller-7998c67dc4-ztqhj\" (UID: \"f6da9e7e-2f57-4baa-a635-2ac347e076f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:41.627157 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.627127    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h972l\" (UniqueName: \"kubernetes.io/projected/f6da9e7e-2f57-4baa-a635-2ac347e076f4-kube-api-access-h972l\") pod \"odh-model-controller-7998c67dc4-ztqhj\" (UID: \"f6da9e7e-2f57-4baa-a635-2ac347e076f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:41.735998 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.735969    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:41.872390 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:41.872339    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ztqhj"]
Jul 27 21:07:41.875531 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:41.875493    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6da9e7e_2f57_4baa_a635_2ac347e076f4.slice/crio-15e76a26d27e4a39e36ed3919da46c34d56ec5bca68ac829b0816ff0b2e7258c WatchSource:0}: Error finding container 15e76a26d27e4a39e36ed3919da46c34d56ec5bca68ac829b0816ff0b2e7258c: Status 404 returned error can't find the container with id 15e76a26d27e4a39e36ed3919da46c34d56ec5bca68ac829b0816ff0b2e7258c
Jul 27 21:07:42.342671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.342639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj" event={"ID":"f6da9e7e-2f57-4baa-a635-2ac347e076f4","Type":"ContainerStarted","Data":"15e76a26d27e4a39e36ed3919da46c34d56ec5bca68ac829b0816ff0b2e7258c"}
Jul 27 21:07:42.459407 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.459375    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltsvn"]
Jul 27 21:07:42.462105 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.462090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:42.464530 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.464508    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-h4v94\""
Jul 27 21:07:42.465321 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.465300    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 21:07:42.474727 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.474699    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltsvn"]
Jul 27 21:07:42.618241 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.618142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ecb359-1e6b-400c-a8ef-b4d010c57ce7-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltsvn\" (UID: \"c6ecb359-1e6b-400c-a8ef-b4d010c57ce7\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:42.618241 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.618235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597xp\" (UniqueName: \"kubernetes.io/projected/c6ecb359-1e6b-400c-a8ef-b4d010c57ce7-kube-api-access-597xp\") pod \"model-serving-api-54d89bd5fc-ltsvn\" (UID: \"c6ecb359-1e6b-400c-a8ef-b4d010c57ce7\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:42.719476 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.719435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ecb359-1e6b-400c-a8ef-b4d010c57ce7-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltsvn\" (UID: \"c6ecb359-1e6b-400c-a8ef-b4d010c57ce7\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:42.719665 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.719520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597xp\" (UniqueName: \"kubernetes.io/projected/c6ecb359-1e6b-400c-a8ef-b4d010c57ce7-kube-api-access-597xp\") pod \"model-serving-api-54d89bd5fc-ltsvn\" (UID: \"c6ecb359-1e6b-400c-a8ef-b4d010c57ce7\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:42.722660 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.722613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6ecb359-1e6b-400c-a8ef-b4d010c57ce7-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltsvn\" (UID: \"c6ecb359-1e6b-400c-a8ef-b4d010c57ce7\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:42.728455 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.728428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-597xp\" (UniqueName: \"kubernetes.io/projected/c6ecb359-1e6b-400c-a8ef-b4d010c57ce7-kube-api-access-597xp\") pod \"model-serving-api-54d89bd5fc-ltsvn\" (UID: \"c6ecb359-1e6b-400c-a8ef-b4d010c57ce7\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:42.776320 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.776290    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:42.912928 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:42.912846    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltsvn"]
Jul 27 21:07:42.917271 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:42.917228    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ecb359_1e6b_400c_a8ef_b4d010c57ce7.slice/crio-d65261e7368ef038afe80adbb7e6e3da884def49001937aca740731d78a6e956 WatchSource:0}: Error finding container d65261e7368ef038afe80adbb7e6e3da884def49001937aca740731d78a6e956: Status 404 returned error can't find the container with id d65261e7368ef038afe80adbb7e6e3da884def49001937aca740731d78a6e956
Jul 27 21:07:43.349019 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:43.348979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn" event={"ID":"c6ecb359-1e6b-400c-a8ef-b4d010c57ce7","Type":"ContainerStarted","Data":"d65261e7368ef038afe80adbb7e6e3da884def49001937aca740731d78a6e956"}
Jul 27 21:07:45.359657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:45.359622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn" event={"ID":"c6ecb359-1e6b-400c-a8ef-b4d010c57ce7","Type":"ContainerStarted","Data":"282eedd9560d6e90714851bc8258bcf34b4457826ade772ce5c10ecb54108ec6"}
Jul 27 21:07:45.360101 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:45.359689    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:45.361121 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:45.361096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj" event={"ID":"f6da9e7e-2f57-4baa-a635-2ac347e076f4","Type":"ContainerStarted","Data":"6cd1fcfbc720aa0f5c470b626248e92f65be0b44f0f4e3668cedcbf56e94a11a"}
Jul 27 21:07:45.361253 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:45.361222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:45.378070 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:45.378021    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn" podStartSLOduration=1.130832788 podStartE2EDuration="3.378005784s" totalImagesPullingTime="2.247172996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:45.377276592 +0000 UTC m=+609.642990712" watchObservedRunningTime="2026-07-27 21:07:45.378005784 +0000 UTC m=+609.643719901"
Jul 27 21:07:45.392838 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:45.392796    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj" podStartSLOduration=1.098868784 podStartE2EDuration="4.392782719s" totalImagesPullingTime="3.293913935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:45.39162602 +0000 UTC m=+609.657340139" watchObservedRunningTime="2026-07-27 21:07:45.392782719 +0000 UTC m=+609.658496837"
Jul 27 21:07:46.517251 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.517198    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"]
Jul 27 21:07:46.519628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.519608    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.522167 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.522140    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 21:07:46.522295 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.522168    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 21:07:46.523206 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.523179    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 21:07:46.523206 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.523198    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-25pjb\""
Jul 27 21:07:46.523387 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.523203    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 21:07:46.536571 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.536549    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"]
Jul 27 21:07:46.653911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.653878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf96b3ef-887f-4799-80f7-f01b76efd176-tls-certs\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.654054 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.653915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcsm8\" (UniqueName: \"kubernetes.io/projected/bf96b3ef-887f-4799-80f7-f01b76efd176-kube-api-access-dcsm8\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.654054 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.653935    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf96b3ef-887f-4799-80f7-f01b76efd176-tmp\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.755274 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.755245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf96b3ef-887f-4799-80f7-f01b76efd176-tls-certs\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.755447 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.755291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcsm8\" (UniqueName: \"kubernetes.io/projected/bf96b3ef-887f-4799-80f7-f01b76efd176-kube-api-access-dcsm8\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.755447 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.755315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf96b3ef-887f-4799-80f7-f01b76efd176-tmp\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.757626 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.757595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf96b3ef-887f-4799-80f7-f01b76efd176-tmp\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.757903 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.757885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf96b3ef-887f-4799-80f7-f01b76efd176-tls-certs\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.764182 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.764153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcsm8\" (UniqueName: \"kubernetes.io/projected/bf96b3ef-887f-4799-80f7-f01b76efd176-kube-api-access-dcsm8\") pod \"kube-auth-proxy-d89c5fb64-pqfd9\" (UID: \"bf96b3ef-887f-4799-80f7-f01b76efd176\") " pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.829751 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.829677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"
Jul 27 21:07:46.952628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:46.952583    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9"]
Jul 27 21:07:46.955162 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:46.955136    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf96b3ef_887f_4799_80f7_f01b76efd176.slice/crio-5bc7beafe88cdd6bd4a7eaa88583f8efd757c1df85f7010f7beac41be8a498bb WatchSource:0}: Error finding container 5bc7beafe88cdd6bd4a7eaa88583f8efd757c1df85f7010f7beac41be8a498bb: Status 404 returned error can't find the container with id 5bc7beafe88cdd6bd4a7eaa88583f8efd757c1df85f7010f7beac41be8a498bb
Jul 27 21:07:47.370305 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.370274    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9" event={"ID":"bf96b3ef-887f-4799-80f7-f01b76efd176","Type":"ContainerStarted","Data":"5bc7beafe88cdd6bd4a7eaa88583f8efd757c1df85f7010f7beac41be8a498bb"}
Jul 27 21:07:47.830825 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.830791    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"]
Jul 27 21:07:47.833163 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.833138    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:47.835699 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.835679    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 21:07:47.835834 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.835679    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 21:07:47.835950 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.835936    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 21:07:47.836187 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.836163    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 21:07:47.836284 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.836178    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-76mmz\""
Jul 27 21:07:47.847044 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.847023    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"]
Jul 27 21:07:47.965594 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.965561    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:47.965766 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.965607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a52143d-c68d-4423-aad5-688548788285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:47.965766 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.965637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:47.965766 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.965679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:47.965766 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.965714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:47.965948 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.965799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a52143d-c68d-4423-aad5-688548788285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:47.965948 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:47.965856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqtjg\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-kube-api-access-mqtjg\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.066659 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.066621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqtjg\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-kube-api-access-mqtjg\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.066825 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.066685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.067314 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.066860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a52143d-c68d-4423-aad5-688548788285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.067314 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.066908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.067314 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.066937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.067314 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.067005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.067314 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.067048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a52143d-c68d-4423-aad5-688548788285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.068438 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.067723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a52143d-c68d-4423-aad5-688548788285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.069972 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.069950    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.070075 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.070010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a52143d-c68d-4423-aad5-688548788285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.070543 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.070479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.070640 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.070558    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.088794 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.088721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqtjg\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-kube-api-access-mqtjg\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.088936 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.088840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5dgft\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.144884 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.144859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:48.310411 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.310376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"]
Jul 27 21:07:48.313429 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:48.313398    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a52143d_c68d_4423_aad5_688548788285.slice/crio-1952d9d9fa1afb14d59651c18e4dc1239643baf3b09a18d9e4a63cc75fd3b775 WatchSource:0}: Error finding container 1952d9d9fa1afb14d59651c18e4dc1239643baf3b09a18d9e4a63cc75fd3b775: Status 404 returned error can't find the container with id 1952d9d9fa1afb14d59651c18e4dc1239643baf3b09a18d9e4a63cc75fd3b775
Jul 27 21:07:48.376564 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:48.376470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft" event={"ID":"3a52143d-c68d-4423-aad5-688548788285","Type":"ContainerStarted","Data":"1952d9d9fa1afb14d59651c18e4dc1239643baf3b09a18d9e4a63cc75fd3b775"}
Jul 27 21:07:50.388615 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:50.388573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9" event={"ID":"bf96b3ef-887f-4799-80f7-f01b76efd176","Type":"ContainerStarted","Data":"c81403ec479a8ef96b8ef6db2c3ca63d09552367e1ba7e5e4bcf14cd10f0cba5"}
Jul 27 21:07:50.413045 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:50.412990    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d89c5fb64-pqfd9" podStartSLOduration=1.875996138 podStartE2EDuration="4.412973763s" totalImagesPullingTime="2.536977625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:50.411114035 +0000 UTC m=+614.676828155" watchObservedRunningTime="2026-07-27 21:07:50.412973763 +0000 UTC m=+614.678687879"
Jul 27 21:07:51.270041 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:51.269994    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:07:51.270155 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:51.270086    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:07:51.394810 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:51.394771    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft" event={"ID":"3a52143d-c68d-4423-aad5-688548788285","Type":"ContainerStarted","Data":"01222c11e9f4dce8e5ad9519187e0926ca5433840fdff13cc9069e5d736568f6"}
Jul 27 21:07:51.395257 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:51.394945    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:51.442756 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:51.442685    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft" podStartSLOduration=1.488602899 podStartE2EDuration="4.442665592s" totalImagesPullingTime="2.954062693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:51.43725632 +0000 UTC m=+615.702970458" watchObservedRunningTime="2026-07-27 21:07:51.442665592 +0000 UTC m=+615.708379715"
Jul 27 21:07:52.022986 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.022950    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"]
Jul 27 21:07:52.025286 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.025268    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:52.028719 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.028692    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zpwdl\""
Jul 27 21:07:52.028859 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.028770    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 21:07:52.038959 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.038937    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"]
Jul 27 21:07:52.041618 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.041603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:52.044780 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.044758    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 21:07:52.044871 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.044819    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rrm9x\""
Jul 27 21:07:52.059228 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.056079    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"]
Jul 27 21:07:52.066085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.066050    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"]
Jul 27 21:07:52.201886 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.201852    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af33f92-0f45-43a0-adb8-a6c1a758ab00-cert\") pod \"kserve-controller-manager-d6f4b65b8-mdz9j\" (UID: \"7af33f92-0f45-43a0-adb8-a6c1a758ab00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:52.202077 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.201897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04aadbe7-0253-4da0-b92f-4067463a6db0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ssrdw\" (UID: \"04aadbe7-0253-4da0-b92f-4067463a6db0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:52.202077 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.201922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqjnq\" (UniqueName: \"kubernetes.io/projected/04aadbe7-0253-4da0-b92f-4067463a6db0-kube-api-access-rqjnq\") pod \"llmisvc-controller-manager-777c6bd7d5-ssrdw\" (UID: \"04aadbe7-0253-4da0-b92f-4067463a6db0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:52.202077 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.201991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cchx\" (UniqueName: \"kubernetes.io/projected/7af33f92-0f45-43a0-adb8-a6c1a758ab00-kube-api-access-8cchx\") pod \"kserve-controller-manager-d6f4b65b8-mdz9j\" (UID: \"7af33f92-0f45-43a0-adb8-a6c1a758ab00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:52.302980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.302890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqjnq\" (UniqueName: \"kubernetes.io/projected/04aadbe7-0253-4da0-b92f-4067463a6db0-kube-api-access-rqjnq\") pod \"llmisvc-controller-manager-777c6bd7d5-ssrdw\" (UID: \"04aadbe7-0253-4da0-b92f-4067463a6db0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:52.302980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.302945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cchx\" (UniqueName: \"kubernetes.io/projected/7af33f92-0f45-43a0-adb8-a6c1a758ab00-kube-api-access-8cchx\") pod \"kserve-controller-manager-d6f4b65b8-mdz9j\" (UID: \"7af33f92-0f45-43a0-adb8-a6c1a758ab00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:52.303232 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.303062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af33f92-0f45-43a0-adb8-a6c1a758ab00-cert\") pod \"kserve-controller-manager-d6f4b65b8-mdz9j\" (UID: \"7af33f92-0f45-43a0-adb8-a6c1a758ab00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:52.303232 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.303110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04aadbe7-0253-4da0-b92f-4067463a6db0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ssrdw\" (UID: \"04aadbe7-0253-4da0-b92f-4067463a6db0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:52.303332 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:07:52.303276    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 27 21:07:52.303387 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:07:52.303378    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7af33f92-0f45-43a0-adb8-a6c1a758ab00-cert podName:7af33f92-0f45-43a0-adb8-a6c1a758ab00 nodeName:}" failed. No retries permitted until 2026-07-27 21:07:52.803358633 +0000 UTC m=+617.069072735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7af33f92-0f45-43a0-adb8-a6c1a758ab00-cert") pod "kserve-controller-manager-d6f4b65b8-mdz9j" (UID: "7af33f92-0f45-43a0-adb8-a6c1a758ab00") : secret "kserve-webhook-server-cert" not found
Jul 27 21:07:52.305657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.305630    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04aadbe7-0253-4da0-b92f-4067463a6db0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ssrdw\" (UID: \"04aadbe7-0253-4da0-b92f-4067463a6db0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:52.313595 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.313569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqjnq\" (UniqueName: \"kubernetes.io/projected/04aadbe7-0253-4da0-b92f-4067463a6db0-kube-api-access-rqjnq\") pod \"llmisvc-controller-manager-777c6bd7d5-ssrdw\" (UID: \"04aadbe7-0253-4da0-b92f-4067463a6db0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:52.315327 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.315303    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cchx\" (UniqueName: \"kubernetes.io/projected/7af33f92-0f45-43a0-adb8-a6c1a758ab00-kube-api-access-8cchx\") pod \"kserve-controller-manager-d6f4b65b8-mdz9j\" (UID: \"7af33f92-0f45-43a0-adb8-a6c1a758ab00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:52.353401 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.353376    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:52.404111 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.403273    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-5dgft container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 21:07:52.404111 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.403322    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft" podUID="3a52143d-c68d-4423-aad5-688548788285" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:07:52.537653 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:52.537627    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod04aadbe7_0253_4da0_b92f_4067463a6db0.slice/crio-99b8c4019e4c63e02471feb762c00000f5a5f739640f279b599a1c9d63d42265 WatchSource:0}: Error finding container 99b8c4019e4c63e02471feb762c00000f5a5f739640f279b599a1c9d63d42265: Status 404 returned error can't find the container with id 99b8c4019e4c63e02471feb762c00000f5a5f739640f279b599a1c9d63d42265
Jul 27 21:07:52.541036 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.541013    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"]
Jul 27 21:07:52.807539 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.807499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af33f92-0f45-43a0-adb8-a6c1a758ab00-cert\") pod \"kserve-controller-manager-d6f4b65b8-mdz9j\" (UID: \"7af33f92-0f45-43a0-adb8-a6c1a758ab00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:52.810803 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.810751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af33f92-0f45-43a0-adb8-a6c1a758ab00-cert\") pod \"kserve-controller-manager-d6f4b65b8-mdz9j\" (UID: \"7af33f92-0f45-43a0-adb8-a6c1a758ab00\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:52.936080 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:52.936041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:53.072346 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:53.072200    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"]
Jul 27 21:07:53.074693 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:53.074670    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af33f92_0f45_43a0_adb8_a6c1a758ab00.slice/crio-5cdf1452177ae7030b94e8b87c2b070f7728ab8efa2775bb775288352c5a9031 WatchSource:0}: Error finding container 5cdf1452177ae7030b94e8b87c2b070f7728ab8efa2775bb775288352c5a9031: Status 404 returned error can't find the container with id 5cdf1452177ae7030b94e8b87c2b070f7728ab8efa2775bb775288352c5a9031
Jul 27 21:07:53.407048 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:53.406971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw" event={"ID":"04aadbe7-0253-4da0-b92f-4067463a6db0","Type":"ContainerStarted","Data":"99b8c4019e4c63e02471feb762c00000f5a5f739640f279b599a1c9d63d42265"}
Jul 27 21:07:53.408248 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:53.408197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j" event={"ID":"7af33f92-0f45-43a0-adb8-a6c1a758ab00","Type":"ContainerStarted","Data":"5cdf1452177ae7030b94e8b87c2b070f7728ab8efa2775bb775288352c5a9031"}
Jul 27 21:07:54.282730 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.282490    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"]
Jul 27 21:07:54.285523 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.285502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.289652 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.289403    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7kvx4\""
Jul 27 21:07:54.306701 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.306633    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"]
Jul 27 21:07:54.420084 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.420628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.420628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cgx9\" (UniqueName: \"kubernetes.io/projected/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-kube-api-access-5cgx9\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.420628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.420628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420202    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.420628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.420628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.420628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420348    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.420628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.420374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.521766 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.521730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.521955 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.521805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.521955 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.521835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.521955 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.521860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.521955 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.521908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522182 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.521964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522182 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.521999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522182 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.522024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cgx9\" (UniqueName: \"kubernetes.io/projected/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-kube-api-access-5cgx9\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522182 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.522077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522411 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.522186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522411 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.522365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522695 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.522571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522695 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.522632    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.522829 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.522753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.525043 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.525001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.525508 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.525454    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.532491 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.532449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.532601 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.532520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cgx9\" (UniqueName: \"kubernetes.io/projected/78362b9a-ff78-45cd-bd2d-ee45cff8d9a7-kube-api-access-5cgx9\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c\" (UID: \"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.601559 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.601482    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:54.800357 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:07:54.800326    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78362b9a_ff78_45cd_bd2d_ee45cff8d9a7.slice/crio-49b95efd8254bc047f5f4234f035cfb7b1c77c98d2455ba41ec25b7d5f1c1829 WatchSource:0}: Error finding container 49b95efd8254bc047f5f4234f035cfb7b1c77c98d2455ba41ec25b7d5f1c1829: Status 404 returned error can't find the container with id 49b95efd8254bc047f5f4234f035cfb7b1c77c98d2455ba41ec25b7d5f1c1829
Jul 27 21:07:54.807999 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:54.807969    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"]
Jul 27 21:07:55.402014 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:55.401985    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:55.420711 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:55.420679    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c" event={"ID":"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7","Type":"ContainerStarted","Data":"49b95efd8254bc047f5f4234f035cfb7b1c77c98d2455ba41ec25b7d5f1c1829"}
Jul 27 21:07:56.367775 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:56.367740    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ztqhj"
Jul 27 21:07:56.372563 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:56.372535    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ltsvn"
Jul 27 21:07:56.977704 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:56.977623    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"]
Jul 27 21:07:56.978143 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:56.977830    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft" podUID="3a52143d-c68d-4423-aad5-688548788285" containerName="discovery" containerID="cri-o://01222c11e9f4dce8e5ad9519187e0926ca5433840fdff13cc9069e5d736568f6" gracePeriod=30
Jul 27 21:07:57.433970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:57.433917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw" event={"ID":"04aadbe7-0253-4da0-b92f-4067463a6db0","Type":"ContainerStarted","Data":"3a15104211caf23dd2c4ae3d9095f91d7eb55e04615149c31a7397f241c725f7"}
Jul 27 21:07:57.434259 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:57.434061    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:07:57.435913 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:57.435879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j" event={"ID":"7af33f92-0f45-43a0-adb8-a6c1a758ab00","Type":"ContainerStarted","Data":"a6849e2205d28d52b23e2be4052abc15b5f48cb3a123d9d2b331762e1f9e16a0"}
Jul 27 21:07:57.436044 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:57.435939    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:07:57.437763 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:57.437739    2575 generic.go:356] "Generic (PLEG): container finished" podID="3a52143d-c68d-4423-aad5-688548788285" containerID="01222c11e9f4dce8e5ad9519187e0926ca5433840fdff13cc9069e5d736568f6" exitCode=0
Jul 27 21:07:57.437864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:57.437793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft" event={"ID":"3a52143d-c68d-4423-aad5-688548788285","Type":"ContainerDied","Data":"01222c11e9f4dce8e5ad9519187e0926ca5433840fdff13cc9069e5d736568f6"}
Jul 27 21:07:57.453898 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:57.453848    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw" podStartSLOduration=1.2986693950000001 podStartE2EDuration="5.453827444s" totalImagesPullingTime="4.155158049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:57.452752511 +0000 UTC m=+621.718466642" watchObservedRunningTime="2026-07-27 21:07:57.453827444 +0000 UTC m=+621.719541563"
Jul 27 21:07:57.471422 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:57.471371    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j" podStartSLOduration=2.855914226 podStartE2EDuration="6.471352186s" totalImagesPullingTime="3.61543796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:57.470150039 +0000 UTC m=+621.735864156" watchObservedRunningTime="2026-07-27 21:07:57.471352186 +0000 UTC m=+621.737066305"
Jul 27 21:07:58.279188 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.279162    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:58.443379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.443296    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft" event={"ID":"3a52143d-c68d-4423-aad5-688548788285","Type":"ContainerDied","Data":"1952d9d9fa1afb14d59651c18e4dc1239643baf3b09a18d9e4a63cc75fd3b775"}
Jul 27 21:07:58.443379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.443323    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"
Jul 27 21:07:58.443379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.443363    2575 scope.go:117] "RemoveContainer" containerID="01222c11e9f4dce8e5ad9519187e0926ca5433840fdff13cc9069e5d736568f6"
Jul 27 21:07:58.456566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.456546    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-cacerts\") pod \"3a52143d-c68d-4423-aad5-688548788285\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") "
Jul 27 21:07:58.456671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.456585    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-istio-token\") pod \"3a52143d-c68d-4423-aad5-688548788285\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") "
Jul 27 21:07:58.456671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.456637    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a52143d-c68d-4423-aad5-688548788285-istio-csr-ca-configmap\") pod \"3a52143d-c68d-4423-aad5-688548788285\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") "
Jul 27 21:07:58.456783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.456674    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqtjg\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-kube-api-access-mqtjg\") pod \"3a52143d-c68d-4423-aad5-688548788285\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") "
Jul 27 21:07:58.456783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.456698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-kubeconfig\") pod \"3a52143d-c68d-4423-aad5-688548788285\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") "
Jul 27 21:07:58.456783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.456713    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a52143d-c68d-4423-aad5-688548788285-local-certs\") pod \"3a52143d-c68d-4423-aad5-688548788285\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") "
Jul 27 21:07:58.456923 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.456823    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-csr-dns-cert\") pod \"3a52143d-c68d-4423-aad5-688548788285\" (UID: \"3a52143d-c68d-4423-aad5-688548788285\") "
Jul 27 21:07:58.457177 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.457151    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a52143d-c68d-4423-aad5-688548788285-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3a52143d-c68d-4423-aad5-688548788285" (UID: "3a52143d-c68d-4423-aad5-688548788285"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:07:58.459131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.459087    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a52143d-c68d-4423-aad5-688548788285-local-certs" (OuterVolumeSpecName: "local-certs") pod "3a52143d-c68d-4423-aad5-688548788285" (UID: "3a52143d-c68d-4423-aad5-688548788285"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:07:58.459131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.459099    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3a52143d-c68d-4423-aad5-688548788285" (UID: "3a52143d-c68d-4423-aad5-688548788285"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:07:58.459428 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.459398    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a52143d-c68d-4423-aad5-688548788285" (UID: "3a52143d-c68d-4423-aad5-688548788285"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:07:58.459428 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.459414    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-kube-api-access-mqtjg" (OuterVolumeSpecName: "kube-api-access-mqtjg") pod "3a52143d-c68d-4423-aad5-688548788285" (UID: "3a52143d-c68d-4423-aad5-688548788285"). InnerVolumeSpecName "kube-api-access-mqtjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:07:58.459602 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.459584    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-cacerts" (OuterVolumeSpecName: "cacerts") pod "3a52143d-c68d-4423-aad5-688548788285" (UID: "3a52143d-c68d-4423-aad5-688548788285"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:07:58.459658 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.459643    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3a52143d-c68d-4423-aad5-688548788285" (UID: "3a52143d-c68d-4423-aad5-688548788285"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:07:58.558275 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.558246    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a52143d-c68d-4423-aad5-688548788285-istio-csr-ca-configmap\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:07:58.558275 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.558268    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqtjg\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-kube-api-access-mqtjg\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:07:58.558275 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.558278    2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-kubeconfig\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:07:58.558512 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.558287    2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a52143d-c68d-4423-aad5-688548788285-local-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:07:58.558512 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.558296    2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-istio-csr-dns-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:07:58.558512 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.558303    2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a52143d-c68d-4423-aad5-688548788285-cacerts\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:07:58.558512 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.558313    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a52143d-c68d-4423-aad5-688548788285-istio-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:07:58.586580 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.586552    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:07:58.586684 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.586615    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:07:58.586684 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.586644    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:07:58.774313 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.774256    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"]
Jul 27 21:07:58.784477 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:58.784440    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5dgft"]
Jul 27 21:07:59.449622 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:59.449588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c" event={"ID":"78362b9a-ff78-45cd-bd2d-ee45cff8d9a7","Type":"ContainerStarted","Data":"39f90eff5a96b590513a03b0d2bb864a64fb2331eec07683d3f0e73ee4b4aea9"}
Jul 27 21:07:59.470294 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:59.470254    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c" podStartSLOduration=1.687007494 podStartE2EDuration="5.470238403s" totalImagesPullingTime="3.783230909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:07:59.46906933 +0000 UTC m=+623.734783448" watchObservedRunningTime="2026-07-27 21:07:59.470238403 +0000 UTC m=+623.735952521"
Jul 27 21:07:59.601814 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:59.601783    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:07:59.606310 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:07:59.606288    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:08:00.277781 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:00.277747    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a52143d-c68d-4423-aad5-688548788285" path="/var/lib/kubelet/pods/3a52143d-c68d-4423-aad5-688548788285/volumes"
Jul 27 21:08:00.453851 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:00.453822    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:08:00.454701 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:00.454678    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c"
Jul 27 21:08:28.445858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:28.445825    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ssrdw"
Jul 27 21:08:28.448665 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:28.448639    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mdz9j"
Jul 27 21:08:42.482150 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.482112    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-29vwx"]
Jul 27 21:08:42.482545 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.482465    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a52143d-c68d-4423-aad5-688548788285" containerName="discovery"
Jul 27 21:08:42.482545 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.482477    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a52143d-c68d-4423-aad5-688548788285" containerName="discovery"
Jul 27 21:08:42.482545 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.482545    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a52143d-c68d-4423-aad5-688548788285" containerName="discovery"
Jul 27 21:08:42.486678 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.486660    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-29vwx"
Jul 27 21:08:42.489168 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.489146    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 21:08:42.489307 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.489239    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6krhz\""
Jul 27 21:08:42.490160 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.490141    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 21:08:42.494727 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.494703    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-29vwx"]
Jul 27 21:08:42.610413 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.610382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9tdl\" (UniqueName: \"kubernetes.io/projected/4e8fbf0d-3bed-460a-85dd-94b9e0a16422-kube-api-access-s9tdl\") pod \"kuadrant-operator-catalog-29vwx\" (UID: \"4e8fbf0d-3bed-460a-85dd-94b9e0a16422\") " pod="kuadrant-system/kuadrant-operator-catalog-29vwx"
Jul 27 21:08:42.711459 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.711421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9tdl\" (UniqueName: \"kubernetes.io/projected/4e8fbf0d-3bed-460a-85dd-94b9e0a16422-kube-api-access-s9tdl\") pod \"kuadrant-operator-catalog-29vwx\" (UID: \"4e8fbf0d-3bed-460a-85dd-94b9e0a16422\") " pod="kuadrant-system/kuadrant-operator-catalog-29vwx"
Jul 27 21:08:42.720158 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.720129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9tdl\" (UniqueName: \"kubernetes.io/projected/4e8fbf0d-3bed-460a-85dd-94b9e0a16422-kube-api-access-s9tdl\") pod \"kuadrant-operator-catalog-29vwx\" (UID: \"4e8fbf0d-3bed-460a-85dd-94b9e0a16422\") " pod="kuadrant-system/kuadrant-operator-catalog-29vwx"
Jul 27 21:08:42.798373 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.798343    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-29vwx"
Jul 27 21:08:42.843254 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.843223    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-29vwx"]
Jul 27 21:08:42.925176 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:42.925142    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-29vwx"]
Jul 27 21:08:42.928755 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:08:42.928722    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8fbf0d_3bed_460a_85dd_94b9e0a16422.slice/crio-4d859fccb0a5f1ec42ecec6491d5a298d5a538aa75db1ad560b0a6bb3129f187 WatchSource:0}: Error finding container 4d859fccb0a5f1ec42ecec6491d5a298d5a538aa75db1ad560b0a6bb3129f187: Status 404 returned error can't find the container with id 4d859fccb0a5f1ec42ecec6491d5a298d5a538aa75db1ad560b0a6bb3129f187
Jul 27 21:08:43.053826 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.053757    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v927g"]
Jul 27 21:08:43.056781 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.056767    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:08:43.064728 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.064710    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v927g"]
Jul 27 21:08:43.216528 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.216503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfjfs\" (UniqueName: \"kubernetes.io/projected/de375f6d-aa8c-4b80-a466-e674b631259c-kube-api-access-cfjfs\") pod \"kuadrant-operator-catalog-v927g\" (UID: \"de375f6d-aa8c-4b80-a466-e674b631259c\") " pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:08:43.317167 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.317091    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfjfs\" (UniqueName: \"kubernetes.io/projected/de375f6d-aa8c-4b80-a466-e674b631259c-kube-api-access-cfjfs\") pod \"kuadrant-operator-catalog-v927g\" (UID: \"de375f6d-aa8c-4b80-a466-e674b631259c\") " pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:08:43.328858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.328833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfjfs\" (UniqueName: \"kubernetes.io/projected/de375f6d-aa8c-4b80-a466-e674b631259c-kube-api-access-cfjfs\") pod \"kuadrant-operator-catalog-v927g\" (UID: \"de375f6d-aa8c-4b80-a466-e674b631259c\") " pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:08:43.366852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.366831    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:08:43.507641 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.507615    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v927g"]
Jul 27 21:08:43.525884 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:08:43.525855    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde375f6d_aa8c_4b80_a466_e674b631259c.slice/crio-df3b56fb9800b4278746a4684cd312ebf6df8c78b54f3d31bd90a1d169b0b674 WatchSource:0}: Error finding container df3b56fb9800b4278746a4684cd312ebf6df8c78b54f3d31bd90a1d169b0b674: Status 404 returned error can't find the container with id df3b56fb9800b4278746a4684cd312ebf6df8c78b54f3d31bd90a1d169b0b674
Jul 27 21:08:43.630817 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.630723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v927g" event={"ID":"de375f6d-aa8c-4b80-a466-e674b631259c","Type":"ContainerStarted","Data":"df3b56fb9800b4278746a4684cd312ebf6df8c78b54f3d31bd90a1d169b0b674"}
Jul 27 21:08:43.632183 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:43.632149    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-29vwx" event={"ID":"4e8fbf0d-3bed-460a-85dd-94b9e0a16422","Type":"ContainerStarted","Data":"4d859fccb0a5f1ec42ecec6491d5a298d5a538aa75db1ad560b0a6bb3129f187"}
Jul 27 21:08:45.643150 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:45.643110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v927g" event={"ID":"de375f6d-aa8c-4b80-a466-e674b631259c","Type":"ContainerStarted","Data":"77a71f8ab7e350c797d95c344c831b337910b3ad6cf1c7267d1870a267261b2d"}
Jul 27 21:08:45.644554 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:45.644528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-29vwx" event={"ID":"4e8fbf0d-3bed-460a-85dd-94b9e0a16422","Type":"ContainerStarted","Data":"0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da"}
Jul 27 21:08:45.644656 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:45.644576    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-29vwx" podUID="4e8fbf0d-3bed-460a-85dd-94b9e0a16422" containerName="registry-server" containerID="cri-o://0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da" gracePeriod=2
Jul 27 21:08:45.658415 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:45.658368    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v927g" podStartSLOduration=1.179594663 podStartE2EDuration="2.65835028s" totalImagesPullingTime="1.478755617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:08:45.657361949 +0000 UTC m=+669.923076071" watchObservedRunningTime="2026-07-27 21:08:45.65835028 +0000 UTC m=+669.924064403"
Jul 27 21:08:45.672054 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:45.672014    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-29vwx" podStartSLOduration=1.598924347 podStartE2EDuration="3.672002814s" totalImagesPullingTime="2.073078467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:08:45.671530599 +0000 UTC m=+669.937244717" watchObservedRunningTime="2026-07-27 21:08:45.672002814 +0000 UTC m=+669.937716931"
Jul 27 21:08:45.887277 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:45.887255    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-29vwx"
Jul 27 21:08:46.041176 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.041147    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9tdl\" (UniqueName: \"kubernetes.io/projected/4e8fbf0d-3bed-460a-85dd-94b9e0a16422-kube-api-access-s9tdl\") pod \"4e8fbf0d-3bed-460a-85dd-94b9e0a16422\" (UID: \"4e8fbf0d-3bed-460a-85dd-94b9e0a16422\") "
Jul 27 21:08:46.043465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.043445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8fbf0d-3bed-460a-85dd-94b9e0a16422-kube-api-access-s9tdl" (OuterVolumeSpecName: "kube-api-access-s9tdl") pod "4e8fbf0d-3bed-460a-85dd-94b9e0a16422" (UID: "4e8fbf0d-3bed-460a-85dd-94b9e0a16422"). InnerVolumeSpecName "kube-api-access-s9tdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:08:46.141661 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.141632    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9tdl\" (UniqueName: \"kubernetes.io/projected/4e8fbf0d-3bed-460a-85dd-94b9e0a16422-kube-api-access-s9tdl\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:08:46.650045 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.650014    2575 generic.go:356] "Generic (PLEG): container finished" podID="4e8fbf0d-3bed-460a-85dd-94b9e0a16422" containerID="0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da" exitCode=0
Jul 27 21:08:46.650476 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.650058    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-29vwx"
Jul 27 21:08:46.650476 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.650098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-29vwx" event={"ID":"4e8fbf0d-3bed-460a-85dd-94b9e0a16422","Type":"ContainerDied","Data":"0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da"}
Jul 27 21:08:46.650476 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.650142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-29vwx" event={"ID":"4e8fbf0d-3bed-460a-85dd-94b9e0a16422","Type":"ContainerDied","Data":"4d859fccb0a5f1ec42ecec6491d5a298d5a538aa75db1ad560b0a6bb3129f187"}
Jul 27 21:08:46.650476 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.650163    2575 scope.go:117] "RemoveContainer" containerID="0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da"
Jul 27 21:08:46.659052 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.659032    2575 scope.go:117] "RemoveContainer" containerID="0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da"
Jul 27 21:08:46.659349 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:08:46.659329    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da\": container with ID starting with 0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da not found: ID does not exist" containerID="0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da"
Jul 27 21:08:46.659430 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.659362    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da"} err="failed to get container status \"0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da\": rpc error: code = NotFound desc = could not find container \"0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da\": container with ID starting with 0431da0fd53dbc889dcf14b25a06be559b4f4b03d7759caa8e542b9ea89865da not found: ID does not exist"
Jul 27 21:08:46.665265 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.665241    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-29vwx"]
Jul 27 21:08:46.669105 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:46.669083    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-29vwx"]
Jul 27 21:08:48.278009 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:48.277978    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e8fbf0d-3bed-460a-85dd-94b9e0a16422" path="/var/lib/kubelet/pods/4e8fbf0d-3bed-460a-85dd-94b9e0a16422/volumes"
Jul 27 21:08:53.367849 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:53.367812    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:08:53.368323 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:53.367893    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:08:53.390783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:53.390750    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:08:53.702749 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:08:53.702668    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-v927g"
Jul 27 21:09:16.267049 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.267012    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d875968df-xdwxv"]
Jul 27 21:09:16.267537 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.267354    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e8fbf0d-3bed-460a-85dd-94b9e0a16422" containerName="registry-server"
Jul 27 21:09:16.267537 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.267367    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e8fbf0d-3bed-460a-85dd-94b9e0a16422" containerName="registry-server"
Jul 27 21:09:16.267537 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.267436    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e8fbf0d-3bed-460a-85dd-94b9e0a16422" containerName="registry-server"
Jul 27 21:09:16.270807 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.270786    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.274703 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.274681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 21:09:16.276385 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.276363    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 21:09:16.276516 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.276395    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 21:09:16.277719 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.277689    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 21:09:16.277853 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.277743    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 21:09:16.277853 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.277779    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5x9c\""
Jul 27 21:09:16.281755 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.281738    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 21:09:16.289059 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.289038    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d875968df-xdwxv"]
Jul 27 21:09:16.393002 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.392971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-oauth-serving-cert\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.393254 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.393040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-trusted-ca-bundle\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.393254 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.393099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26967ff6-d2d2-445a-80ef-1f851739dc29-console-serving-cert\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.393254 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.393130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-console-config\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.393254 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.393153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5j25\" (UniqueName: \"kubernetes.io/projected/26967ff6-d2d2-445a-80ef-1f851739dc29-kube-api-access-q5j25\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.393453 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.393206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26967ff6-d2d2-445a-80ef-1f851739dc29-console-oauth-config\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.393453 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.393305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-service-ca\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.494063 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.494023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-trusted-ca-bundle\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.494063 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.494073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26967ff6-d2d2-445a-80ef-1f851739dc29-console-serving-cert\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.494315 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.494102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-console-config\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.494315 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.494256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5j25\" (UniqueName: \"kubernetes.io/projected/26967ff6-d2d2-445a-80ef-1f851739dc29-kube-api-access-q5j25\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.494315 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.494297    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26967ff6-d2d2-445a-80ef-1f851739dc29-console-oauth-config\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.494445 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.494320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-service-ca\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.494445 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.494360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-oauth-serving-cert\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.495009 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.494987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-service-ca\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.495106 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.495089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-trusted-ca-bundle\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.495145 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.495116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-console-config\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.495327 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.495307    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26967ff6-d2d2-445a-80ef-1f851739dc29-oauth-serving-cert\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.496778 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.496751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26967ff6-d2d2-445a-80ef-1f851739dc29-console-serving-cert\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.496865 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.496792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26967ff6-d2d2-445a-80ef-1f851739dc29-console-oauth-config\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.513821 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.513798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5j25\" (UniqueName: \"kubernetes.io/projected/26967ff6-d2d2-445a-80ef-1f851739dc29-kube-api-access-q5j25\") pod \"console-6d875968df-xdwxv\" (UID: \"26967ff6-d2d2-445a-80ef-1f851739dc29\") " pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.582045 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.581948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:16.700330 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.700296    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"]
Jul 27 21:09:16.705007 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.704985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:16.707465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.707445    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sjd55\""
Jul 27 21:09:16.722115 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.722093    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"]
Jul 27 21:09:16.736105 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.736074    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d875968df-xdwxv"]
Jul 27 21:09:16.739156 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:09:16.739133    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26967ff6_d2d2_445a_80ef_1f851739dc29.slice/crio-6a874f789816bab9f872573b6ccd0d6d8afacb616445c634c7059f879f284aee WatchSource:0}: Error finding container 6a874f789816bab9f872573b6ccd0d6d8afacb616445c634c7059f879f284aee: Status 404 returned error can't find the container with id 6a874f789816bab9f872573b6ccd0d6d8afacb616445c634c7059f879f284aee
Jul 27 21:09:16.787924 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.787898    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d875968df-xdwxv" event={"ID":"26967ff6-d2d2-445a-80ef-1f851739dc29","Type":"ContainerStarted","Data":"6a874f789816bab9f872573b6ccd0d6d8afacb616445c634c7059f879f284aee"}
Jul 27 21:09:16.797624 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.797599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f3b5044-039d-47a9-ba14-ba390a6f4638-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" (UID: \"3f3b5044-039d-47a9-ba14-ba390a6f4638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:16.797774 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.797663    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hws7v\" (UniqueName: \"kubernetes.io/projected/3f3b5044-039d-47a9-ba14-ba390a6f4638-kube-api-access-hws7v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" (UID: \"3f3b5044-039d-47a9-ba14-ba390a6f4638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:16.898650 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.898566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hws7v\" (UniqueName: \"kubernetes.io/projected/3f3b5044-039d-47a9-ba14-ba390a6f4638-kube-api-access-hws7v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" (UID: \"3f3b5044-039d-47a9-ba14-ba390a6f4638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:16.898650 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.898640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f3b5044-039d-47a9-ba14-ba390a6f4638-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" (UID: \"3f3b5044-039d-47a9-ba14-ba390a6f4638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:16.898964 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.898947    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f3b5044-039d-47a9-ba14-ba390a6f4638-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" (UID: \"3f3b5044-039d-47a9-ba14-ba390a6f4638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:16.910394 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:16.910367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hws7v\" (UniqueName: \"kubernetes.io/projected/3f3b5044-039d-47a9-ba14-ba390a6f4638-kube-api-access-hws7v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" (UID: \"3f3b5044-039d-47a9-ba14-ba390a6f4638\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:17.016121 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:17.016090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:17.176642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:17.176562    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"]
Jul 27 21:09:17.179768 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:09:17.179736    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3b5044_039d_47a9_ba14_ba390a6f4638.slice/crio-caee731fc00e3de2abf3588512c96e4c2cddc112b679f56b6c5c45f4ec33999a WatchSource:0}: Error finding container caee731fc00e3de2abf3588512c96e4c2cddc112b679f56b6c5c45f4ec33999a: Status 404 returned error can't find the container with id caee731fc00e3de2abf3588512c96e4c2cddc112b679f56b6c5c45f4ec33999a
Jul 27 21:09:17.182485 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:17.182465    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:09:17.795387 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:17.795343    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x" event={"ID":"3f3b5044-039d-47a9-ba14-ba390a6f4638","Type":"ContainerStarted","Data":"caee731fc00e3de2abf3588512c96e4c2cddc112b679f56b6c5c45f4ec33999a"}
Jul 27 21:09:17.797338 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:17.797305    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d875968df-xdwxv" event={"ID":"26967ff6-d2d2-445a-80ef-1f851739dc29","Type":"ContainerStarted","Data":"3cd15b1e30fa205806972dd60c32e72bc51f2f6c309c1bd177e3ca676abbb7e9"}
Jul 27 21:09:17.819427 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:17.819363    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d875968df-xdwxv" podStartSLOduration=1.819344112 podStartE2EDuration="1.819344112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:09:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:09:17.816270873 +0000 UTC m=+702.081984991" watchObservedRunningTime="2026-07-27 21:09:17.819344112 +0000 UTC m=+702.085058235"
Jul 27 21:09:18.482528 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.482493    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"]
Jul 27 21:09:18.486347 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.486331    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"
Jul 27 21:09:18.490294 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.490272    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-svjvf\""
Jul 27 21:09:18.490553 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.490539    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 21:09:18.497891 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.497865    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"]
Jul 27 21:09:18.613781 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.613745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfjz4\" (UniqueName: \"kubernetes.io/projected/e596f0dd-90a9-416c-bf4f-3b4e42fc02ad-kube-api-access-wfjz4\") pod \"dns-operator-controller-manager-864dd78c4c-wgswk\" (UID: \"e596f0dd-90a9-416c-bf4f-3b4e42fc02ad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"
Jul 27 21:09:18.714849 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.714811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjz4\" (UniqueName: \"kubernetes.io/projected/e596f0dd-90a9-416c-bf4f-3b4e42fc02ad-kube-api-access-wfjz4\") pod \"dns-operator-controller-manager-864dd78c4c-wgswk\" (UID: \"e596f0dd-90a9-416c-bf4f-3b4e42fc02ad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"
Jul 27 21:09:18.726452 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.726422    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfjz4\" (UniqueName: \"kubernetes.io/projected/e596f0dd-90a9-416c-bf4f-3b4e42fc02ad-kube-api-access-wfjz4\") pod \"dns-operator-controller-manager-864dd78c4c-wgswk\" (UID: \"e596f0dd-90a9-416c-bf4f-3b4e42fc02ad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"
Jul 27 21:09:18.796983 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.796942    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"
Jul 27 21:09:18.966382 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:18.966350    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"]
Jul 27 21:09:18.969810 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:09:18.969782    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode596f0dd_90a9_416c_bf4f_3b4e42fc02ad.slice/crio-69c943c8570fdb6d8f4dbb8e5d29c8cbdeb5ffad685df018d7567995c7d5293a WatchSource:0}: Error finding container 69c943c8570fdb6d8f4dbb8e5d29c8cbdeb5ffad685df018d7567995c7d5293a: Status 404 returned error can't find the container with id 69c943c8570fdb6d8f4dbb8e5d29c8cbdeb5ffad685df018d7567995c7d5293a
Jul 27 21:09:19.809479 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:19.809440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk" event={"ID":"e596f0dd-90a9-416c-bf4f-3b4e42fc02ad","Type":"ContainerStarted","Data":"69c943c8570fdb6d8f4dbb8e5d29c8cbdeb5ffad685df018d7567995c7d5293a"}
Jul 27 21:09:21.279451 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.279420    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"]
Jul 27 21:09:21.282697 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.282682    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:21.285570 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.285554    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h2lbr\""
Jul 27 21:09:21.294204 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.294177    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"]
Jul 27 21:09:21.339332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.339296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmw7x\" (UniqueName: \"kubernetes.io/projected/43adea80-2729-4c80-bfad-6243da1d2804-kube-api-access-zmw7x\") pod \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" (UID: \"43adea80-2729-4c80-bfad-6243da1d2804\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:21.440921 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.440878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmw7x\" (UniqueName: \"kubernetes.io/projected/43adea80-2729-4c80-bfad-6243da1d2804-kube-api-access-zmw7x\") pod \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" (UID: \"43adea80-2729-4c80-bfad-6243da1d2804\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:21.452794 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.452761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmw7x\" (UniqueName: \"kubernetes.io/projected/43adea80-2729-4c80-bfad-6243da1d2804-kube-api-access-zmw7x\") pod \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" (UID: \"43adea80-2729-4c80-bfad-6243da1d2804\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:21.592312 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.592234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:21.821621 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.821585    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk" event={"ID":"e596f0dd-90a9-416c-bf4f-3b4e42fc02ad","Type":"ContainerStarted","Data":"c1949e12f2d3ce3e7eb428a4089567d324f97c510a380f26434a2be132fd038c"}
Jul 27 21:09:21.821913 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.821707    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"
Jul 27 21:09:21.847371 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:21.847250    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk" podStartSLOduration=2.048893383 podStartE2EDuration="3.847231564s" totalImagesPullingTime="1.798338181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:09:21.846296665 +0000 UTC m=+706.112010786" watchObservedRunningTime="2026-07-27 21:09:21.847231564 +0000 UTC m=+706.112945674"
Jul 27 21:09:22.916453 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:22.916432    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"]
Jul 27 21:09:22.920081 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:09:22.919930    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43adea80_2729_4c80_bfad_6243da1d2804.slice/crio-654a9625cef1072c0937ab8deaf0c14e7c48f8a1ad73c72d81f879f19b7b42db WatchSource:0}: Error finding container 654a9625cef1072c0937ab8deaf0c14e7c48f8a1ad73c72d81f879f19b7b42db: Status 404 returned error can't find the container with id 654a9625cef1072c0937ab8deaf0c14e7c48f8a1ad73c72d81f879f19b7b42db
Jul 27 21:09:23.835614 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:23.835575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7" event={"ID":"43adea80-2729-4c80-bfad-6243da1d2804","Type":"ContainerStarted","Data":"654a9625cef1072c0937ab8deaf0c14e7c48f8a1ad73c72d81f879f19b7b42db"}
Jul 27 21:09:23.837449 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:23.837418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x" event={"ID":"3f3b5044-039d-47a9-ba14-ba390a6f4638","Type":"ContainerStarted","Data":"4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254"}
Jul 27 21:09:23.837599 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:23.837488    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:23.857714 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:23.857668    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x" podStartSLOduration=2.200526042 podStartE2EDuration="7.857652312s" totalImagesPullingTime="5.65712627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:09:23.856192157 +0000 UTC m=+708.121906275" watchObservedRunningTime="2026-07-27 21:09:23.857652312 +0000 UTC m=+708.123366514"
Jul 27 21:09:24.781288 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.781251    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"]
Jul 27 21:09:24.784878 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.784855    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"
Jul 27 21:09:24.789464 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.789444    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dzbtn\""
Jul 27 21:09:24.797423 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.797399    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"]
Jul 27 21:09:24.846467 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.846429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7" event={"ID":"43adea80-2729-4c80-bfad-6243da1d2804","Type":"ContainerStarted","Data":"d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18"}
Jul 27 21:09:24.846621 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.846518    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:24.862656 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.862600    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7" podStartSLOduration=2.457739484 podStartE2EDuration="3.862581419s" totalImagesPullingTime="1.404841935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:09:24.861890529 +0000 UTC m=+709.127604672" watchObservedRunningTime="2026-07-27 21:09:24.862581419 +0000 UTC m=+709.128295556"
Jul 27 21:09:24.873784 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.873752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kksj\" (UniqueName: \"kubernetes.io/projected/b0e0749c-172d-4d94-aa67-b4b08b49ff78-kube-api-access-5kksj\") pod \"authorino-operator-75cc8d5cb7-pmw4d\" (UID: \"b0e0749c-172d-4d94-aa67-b4b08b49ff78\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"
Jul 27 21:09:24.975116 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.975073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kksj\" (UniqueName: \"kubernetes.io/projected/b0e0749c-172d-4d94-aa67-b4b08b49ff78-kube-api-access-5kksj\") pod \"authorino-operator-75cc8d5cb7-pmw4d\" (UID: \"b0e0749c-172d-4d94-aa67-b4b08b49ff78\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"
Jul 27 21:09:24.984492 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:24.984465    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kksj\" (UniqueName: \"kubernetes.io/projected/b0e0749c-172d-4d94-aa67-b4b08b49ff78-kube-api-access-5kksj\") pod \"authorino-operator-75cc8d5cb7-pmw4d\" (UID: \"b0e0749c-172d-4d94-aa67-b4b08b49ff78\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"
Jul 27 21:09:25.094590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:25.094497    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"
Jul 27 21:09:25.252993 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:25.252961    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"]
Jul 27 21:09:25.254447 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:09:25.254414    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e0749c_172d_4d94_aa67_b4b08b49ff78.slice/crio-d88d9b27b664f1a04b71dd3ccd71b7cb5601702bb5b90d5772eedfc63f674cbb WatchSource:0}: Error finding container d88d9b27b664f1a04b71dd3ccd71b7cb5601702bb5b90d5772eedfc63f674cbb: Status 404 returned error can't find the container with id d88d9b27b664f1a04b71dd3ccd71b7cb5601702bb5b90d5772eedfc63f674cbb
Jul 27 21:09:25.858842 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:25.858781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d" event={"ID":"b0e0749c-172d-4d94-aa67-b4b08b49ff78","Type":"ContainerStarted","Data":"d88d9b27b664f1a04b71dd3ccd71b7cb5601702bb5b90d5772eedfc63f674cbb"}
Jul 27 21:09:26.582931 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:26.582849    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:26.582931 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:26.582919    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:26.589059 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:26.589034    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:26.869424 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:26.869301    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d875968df-xdwxv"
Jul 27 21:09:27.870418 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:27.870381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d" event={"ID":"b0e0749c-172d-4d94-aa67-b4b08b49ff78","Type":"ContainerStarted","Data":"1efbd1273c94c02828ac7446b8f4a041f07f1982575d18351a943aceb91fc94d"}
Jul 27 21:09:27.870815 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:27.870475    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"
Jul 27 21:09:27.887350 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:27.887299    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d" podStartSLOduration=1.827038441 podStartE2EDuration="3.887282155s" totalImagesPullingTime="2.060243714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:09:27.885014691 +0000 UTC m=+712.150728808" watchObservedRunningTime="2026-07-27 21:09:27.887282155 +0000 UTC m=+712.152996274"
Jul 27 21:09:32.830180 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:32.830144    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wgswk"
Jul 27 21:09:34.849601 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:34.849562    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:35.861856 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:35.861818    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:36.984757 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:36.984720    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"]
Jul 27 21:09:36.985331 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:36.984919    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" containerName="manager" containerID="cri-o://4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254" gracePeriod=2
Jul 27 21:09:36.996061 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:36.996029    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"]
Jul 27 21:09:37.006173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.006145    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"]
Jul 27 21:09:37.006439 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.006402    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7" podUID="43adea80-2729-4c80-bfad-6243da1d2804" containerName="manager" containerID="cri-o://d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18" gracePeriod=2
Jul 27 21:09:37.008797 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.008752    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.013573 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.013483    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"]
Jul 27 21:09:37.013858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.013844    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" containerName="manager"
Jul 27 21:09:37.013925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.013860    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" containerName="manager"
Jul 27 21:09:37.013983 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.013935    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" containerName="manager"
Jul 27 21:09:37.017471 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.017452    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"]
Jul 27 21:09:37.017561 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.017534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.032599 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.032571    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"]
Jul 27 21:09:37.039596 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.039566    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"]
Jul 27 21:09:37.039929 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.039916    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43adea80-2729-4c80-bfad-6243da1d2804" containerName="manager"
Jul 27 21:09:37.039997 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.039930    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="43adea80-2729-4c80-bfad-6243da1d2804" containerName="manager"
Jul 27 21:09:37.040088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.040002    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="43adea80-2729-4c80-bfad-6243da1d2804" containerName="manager"
Jul 27 21:09:37.042834 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.042815    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"
Jul 27 21:09:37.056364 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.056327    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="43adea80-2729-4c80-bfad-6243da1d2804" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:37.058671 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.058643    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.064945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.064921    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"]
Jul 27 21:09:37.089335 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.089295    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="43adea80-2729-4c80-bfad-6243da1d2804" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:37.091348 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.091322    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.187004 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.186954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77af6e64-97f9-49ba-8304-0f66c16d3c59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qpqcq\" (UID: \"77af6e64-97f9-49ba-8304-0f66c16d3c59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.187004 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.187002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnj74\" (UniqueName: \"kubernetes.io/projected/266ee37d-7ca5-44f1-9232-df8971422f20-kube-api-access-jnj74\") pod \"limitador-operator-controller-manager-859d7b78bd-7mnxg\" (UID: \"266ee37d-7ca5-44f1-9232-df8971422f20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"
Jul 27 21:09:37.187285 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.187113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s88z9\" (UniqueName: \"kubernetes.io/projected/77af6e64-97f9-49ba-8304-0f66c16d3c59-kube-api-access-s88z9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qpqcq\" (UID: \"77af6e64-97f9-49ba-8304-0f66c16d3c59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.260053 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.260025    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.262379 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.262354    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.262605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.262592    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:37.264171 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.264149    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="43adea80-2729-4c80-bfad-6243da1d2804" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:37.266115 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.266094    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.267937 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.267917    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="43adea80-2729-4c80-bfad-6243da1d2804" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:37.287911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.287885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77af6e64-97f9-49ba-8304-0f66c16d3c59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qpqcq\" (UID: \"77af6e64-97f9-49ba-8304-0f66c16d3c59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.287911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.287914    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnj74\" (UniqueName: \"kubernetes.io/projected/266ee37d-7ca5-44f1-9232-df8971422f20-kube-api-access-jnj74\") pod \"limitador-operator-controller-manager-859d7b78bd-7mnxg\" (UID: \"266ee37d-7ca5-44f1-9232-df8971422f20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"
Jul 27 21:09:37.288067 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.287936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s88z9\" (UniqueName: \"kubernetes.io/projected/77af6e64-97f9-49ba-8304-0f66c16d3c59-kube-api-access-s88z9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qpqcq\" (UID: \"77af6e64-97f9-49ba-8304-0f66c16d3c59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.288254 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.288236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77af6e64-97f9-49ba-8304-0f66c16d3c59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qpqcq\" (UID: \"77af6e64-97f9-49ba-8304-0f66c16d3c59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.322878 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.322847    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s88z9\" (UniqueName: \"kubernetes.io/projected/77af6e64-97f9-49ba-8304-0f66c16d3c59-kube-api-access-s88z9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qpqcq\" (UID: \"77af6e64-97f9-49ba-8304-0f66c16d3c59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.348896 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.348862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnj74\" (UniqueName: \"kubernetes.io/projected/266ee37d-7ca5-44f1-9232-df8971422f20-kube-api-access-jnj74\") pod \"limitador-operator-controller-manager-859d7b78bd-7mnxg\" (UID: \"266ee37d-7ca5-44f1-9232-df8971422f20\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"
Jul 27 21:09:37.388485 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.388454    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f3b5044-039d-47a9-ba14-ba390a6f4638-extensions-socket-volume\") pod \"3f3b5044-039d-47a9-ba14-ba390a6f4638\" (UID: \"3f3b5044-039d-47a9-ba14-ba390a6f4638\") "
Jul 27 21:09:37.388640 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.388504    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hws7v\" (UniqueName: \"kubernetes.io/projected/3f3b5044-039d-47a9-ba14-ba390a6f4638-kube-api-access-hws7v\") pod \"3f3b5044-039d-47a9-ba14-ba390a6f4638\" (UID: \"3f3b5044-039d-47a9-ba14-ba390a6f4638\") "
Jul 27 21:09:37.388640 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.388528    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmw7x\" (UniqueName: \"kubernetes.io/projected/43adea80-2729-4c80-bfad-6243da1d2804-kube-api-access-zmw7x\") pod \"43adea80-2729-4c80-bfad-6243da1d2804\" (UID: \"43adea80-2729-4c80-bfad-6243da1d2804\") "
Jul 27 21:09:37.388844 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.388820    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3b5044-039d-47a9-ba14-ba390a6f4638-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3f3b5044-039d-47a9-ba14-ba390a6f4638" (UID: "3f3b5044-039d-47a9-ba14-ba390a6f4638"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:09:37.390674 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.390653    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43adea80-2729-4c80-bfad-6243da1d2804-kube-api-access-zmw7x" (OuterVolumeSpecName: "kube-api-access-zmw7x") pod "43adea80-2729-4c80-bfad-6243da1d2804" (UID: "43adea80-2729-4c80-bfad-6243da1d2804"). InnerVolumeSpecName "kube-api-access-zmw7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:37.390744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.390667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3b5044-039d-47a9-ba14-ba390a6f4638-kube-api-access-hws7v" (OuterVolumeSpecName: "kube-api-access-hws7v") pod "3f3b5044-039d-47a9-ba14-ba390a6f4638" (UID: "3f3b5044-039d-47a9-ba14-ba390a6f4638"). InnerVolumeSpecName "kube-api-access-hws7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:09:37.432005 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.431969    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.439927 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.439899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"
Jul 27 21:09:37.489885 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.489851    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f3b5044-039d-47a9-ba14-ba390a6f4638-extensions-socket-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:09:37.489951 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.489895    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hws7v\" (UniqueName: \"kubernetes.io/projected/3f3b5044-039d-47a9-ba14-ba390a6f4638-kube-api-access-hws7v\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:09:37.489951 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.489911    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmw7x\" (UniqueName: \"kubernetes.io/projected/43adea80-2729-4c80-bfad-6243da1d2804-kube-api-access-zmw7x\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:09:37.601414 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.601382    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"]
Jul 27 21:09:37.604734 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:09:37.604711    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77af6e64_97f9_49ba_8304_0f66c16d3c59.slice/crio-1f52dde6741d4ab963e5aea5eb9490bec4694367f64c0954877d9baec6da59a0 WatchSource:0}: Error finding container 1f52dde6741d4ab963e5aea5eb9490bec4694367f64c0954877d9baec6da59a0: Status 404 returned error can't find the container with id 1f52dde6741d4ab963e5aea5eb9490bec4694367f64c0954877d9baec6da59a0
Jul 27 21:09:37.631665 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.631641    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"]
Jul 27 21:09:37.642445 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:09:37.642422    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266ee37d_7ca5_44f1_9232_df8971422f20.slice/crio-edb9e6b5b9dde2b40cc0f454d293be936fdc70232aed24f1744f6eb94d281fc4 WatchSource:0}: Error finding container edb9e6b5b9dde2b40cc0f454d293be936fdc70232aed24f1744f6eb94d281fc4: Status 404 returned error can't find the container with id edb9e6b5b9dde2b40cc0f454d293be936fdc70232aed24f1744f6eb94d281fc4
Jul 27 21:09:37.918728 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.918644    2575 generic.go:356] "Generic (PLEG): container finished" podID="43adea80-2729-4c80-bfad-6243da1d2804" containerID="d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18" exitCode=0
Jul 27 21:09:37.918728 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.918695    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:37.918728 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.918724    2575 scope.go:117] "RemoveContainer" containerID="d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18"
Jul 27 21:09:37.920522 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.920469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg" event={"ID":"266ee37d-7ca5-44f1-9232-df8971422f20","Type":"ContainerStarted","Data":"2fbf76253cbdad917a09e0e6d57773f5a7c8cac9794a6641dc2258b153cc9154"}
Jul 27 21:09:37.920640 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.920531    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg" event={"ID":"266ee37d-7ca5-44f1-9232-df8971422f20","Type":"ContainerStarted","Data":"edb9e6b5b9dde2b40cc0f454d293be936fdc70232aed24f1744f6eb94d281fc4"}
Jul 27 21:09:37.920640 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.920563    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"
Jul 27 21:09:37.921144 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.921120    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.922272 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.922250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq" event={"ID":"77af6e64-97f9-49ba-8304-0f66c16d3c59","Type":"ContainerStarted","Data":"deff6cb6ad4dd910872dbad098ac3091d1b16c12c7b212ab0dcb689410b1af87"}
Jul 27 21:09:37.922385 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.922295    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:09:37.922385 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.922316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq" event={"ID":"77af6e64-97f9-49ba-8304-0f66c16d3c59","Type":"ContainerStarted","Data":"1f52dde6741d4ab963e5aea5eb9490bec4694367f64c0954877d9baec6da59a0"}
Jul 27 21:09:37.925612 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.925554    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="43adea80-2729-4c80-bfad-6243da1d2804" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:37.926735 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.926713    2575 generic.go:356] "Generic (PLEG): container finished" podID="3f3b5044-039d-47a9-ba14-ba390a6f4638" containerID="4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254" exitCode=0
Jul 27 21:09:37.926841 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.926776    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.929419 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.929396    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.933122 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.933099    2575 scope.go:117] "RemoveContainer" containerID="d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18"
Jul 27 21:09:37.935908 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.935876    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18\": container with ID starting with d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18 not found: ID does not exist" containerID="d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18"
Jul 27 21:09:37.936014 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.935919    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18"} err="failed to get container status \"d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18\": rpc error: code = NotFound desc = could not find container \"d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18\": container with ID starting with d20a32202d71b3f97fd455ea635344f8b27cfc596cec650a631d6782beeffa18 not found: ID does not exist"
Jul 27 21:09:37.936014 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.935944    2575 scope.go:117] "RemoveContainer" containerID="4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254"
Jul 27 21:09:37.948688 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.948629    2575 scope.go:117] "RemoveContainer" containerID="4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254"
Jul 27 21:09:37.949027 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.948995    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254\": container with ID starting with 4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254 not found: ID does not exist" containerID="4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254"
Jul 27 21:09:37.949124 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.949034    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254"} err="failed to get container status \"4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254\": rpc error: code = NotFound desc = could not find container \"4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254\": container with ID starting with 4012d1bab638650cb874e323011cf1127df066869b8eaae4b90f50250c1cb254 not found: ID does not exist"
Jul 27 21:09:37.949124 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.949038    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg" podStartSLOduration=0.949021111 podStartE2EDuration="949.021111ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:09:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:09:37.948348682 +0000 UTC m=+722.214062800" watchObservedRunningTime="2026-07-27 21:09:37.949021111 +0000 UTC m=+722.214735229"
Jul 27 21:09:37.973082 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:37.973033    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq" podStartSLOduration=1.973017869 podStartE2EDuration="1.973017869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:09:37.971871351 +0000 UTC m=+722.237585470" watchObservedRunningTime="2026-07-27 21:09:37.973017869 +0000 UTC m=+722.238731987"
Jul 27 21:09:37.974160 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.974130    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="43adea80-2729-4c80-bfad-6243da1d2804" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:37.976634 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.976610    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-khq8x\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-khq8x"
Jul 27 21:09:37.979192 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:09:37.979169    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bjrd7\" is forbidden: User \"system:node:ip-10-0-131-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-197.ec2.internal' and this object" podUID="43adea80-2729-4c80-bfad-6243da1d2804" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bjrd7"
Jul 27 21:09:38.277288 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:38.277254    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3b5044-039d-47a9-ba14-ba390a6f4638" path="/var/lib/kubelet/pods/3f3b5044-039d-47a9-ba14-ba390a6f4638/volumes"
Jul 27 21:09:38.277674 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:38.277574    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43adea80-2729-4c80-bfad-6243da1d2804" path="/var/lib/kubelet/pods/43adea80-2729-4c80-bfad-6243da1d2804/volumes"
Jul 27 21:09:38.877969 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:38.877935    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pmw4d"
Jul 27 21:09:48.936322 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:48.936281    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7mnxg"
Jul 27 21:09:48.936821 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:09:48.936454    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:10:08.909900 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:08.909860    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"]
Jul 27 21:10:08.910889 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:08.910087    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq" podUID="77af6e64-97f9-49ba-8304-0f66c16d3c59" containerName="manager" containerID="cri-o://deff6cb6ad4dd910872dbad098ac3091d1b16c12c7b212ab0dcb689410b1af87" gracePeriod=10
Jul 27 21:10:08.934875 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:08.934833    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq" podUID="77af6e64-97f9-49ba-8304-0f66c16d3c59" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.36:8081/readyz\": dial tcp 10.133.0.36:8081: connect: connection refused"
Jul 27 21:10:09.079186 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.079158    2575 generic.go:356] "Generic (PLEG): container finished" podID="77af6e64-97f9-49ba-8304-0f66c16d3c59" containerID="deff6cb6ad4dd910872dbad098ac3091d1b16c12c7b212ab0dcb689410b1af87" exitCode=0
Jul 27 21:10:09.079348 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.079257    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq" event={"ID":"77af6e64-97f9-49ba-8304-0f66c16d3c59","Type":"ContainerDied","Data":"deff6cb6ad4dd910872dbad098ac3091d1b16c12c7b212ab0dcb689410b1af87"}
Jul 27 21:10:09.173259 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.173166    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:10:09.243415 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.243376    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s88z9\" (UniqueName: \"kubernetes.io/projected/77af6e64-97f9-49ba-8304-0f66c16d3c59-kube-api-access-s88z9\") pod \"77af6e64-97f9-49ba-8304-0f66c16d3c59\" (UID: \"77af6e64-97f9-49ba-8304-0f66c16d3c59\") "
Jul 27 21:10:09.243586 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.243471    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77af6e64-97f9-49ba-8304-0f66c16d3c59-extensions-socket-volume\") pod \"77af6e64-97f9-49ba-8304-0f66c16d3c59\" (UID: \"77af6e64-97f9-49ba-8304-0f66c16d3c59\") "
Jul 27 21:10:09.243900 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.243865    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77af6e64-97f9-49ba-8304-0f66c16d3c59-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77af6e64-97f9-49ba-8304-0f66c16d3c59" (UID: "77af6e64-97f9-49ba-8304-0f66c16d3c59"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:10:09.245771 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.245749    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77af6e64-97f9-49ba-8304-0f66c16d3c59-kube-api-access-s88z9" (OuterVolumeSpecName: "kube-api-access-s88z9") pod "77af6e64-97f9-49ba-8304-0f66c16d3c59" (UID: "77af6e64-97f9-49ba-8304-0f66c16d3c59"). InnerVolumeSpecName "kube-api-access-s88z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:10:09.345033 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.344986    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77af6e64-97f9-49ba-8304-0f66c16d3c59-extensions-socket-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:10:09.345033 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:09.345025    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s88z9\" (UniqueName: \"kubernetes.io/projected/77af6e64-97f9-49ba-8304-0f66c16d3c59-kube-api-access-s88z9\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:10:10.085988 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:10.085943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq" event={"ID":"77af6e64-97f9-49ba-8304-0f66c16d3c59","Type":"ContainerDied","Data":"1f52dde6741d4ab963e5aea5eb9490bec4694367f64c0954877d9baec6da59a0"}
Jul 27 21:10:10.086461 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:10.086036    2575 scope.go:117] "RemoveContainer" containerID="deff6cb6ad4dd910872dbad098ac3091d1b16c12c7b212ab0dcb689410b1af87"
Jul 27 21:10:10.086461 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:10.085958    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"
Jul 27 21:10:10.109655 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:10.109628    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"]
Jul 27 21:10:10.113879 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:10.113855    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qpqcq"]
Jul 27 21:10:10.277133 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:10.277100    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77af6e64-97f9-49ba-8304-0f66c16d3c59" path="/var/lib/kubelet/pods/77af6e64-97f9-49ba-8304-0f66c16d3c59/volumes"
Jul 27 21:10:25.336229 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.336179    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"]
Jul 27 21:10:25.336791 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.336729    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77af6e64-97f9-49ba-8304-0f66c16d3c59" containerName="manager"
Jul 27 21:10:25.336791 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.336749    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="77af6e64-97f9-49ba-8304-0f66c16d3c59" containerName="manager"
Jul 27 21:10:25.336911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.336835    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="77af6e64-97f9-49ba-8304-0f66c16d3c59" containerName="manager"
Jul 27 21:10:25.339570 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.339549    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.342676 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.342653    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6n5rw\""
Jul 27 21:10:25.355071 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.355050    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"]
Jul 27 21:10:25.391308 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.391469 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.391469 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.391469 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.391469 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.391659 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.391694 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t79ld\" (UniqueName: \"kubernetes.io/projected/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-kube-api-access-t79ld\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.391731 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.391731 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.391713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.492819 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.492786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493007 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.492831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493007 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.492859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493125    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t79ld\" (UniqueName: \"kubernetes.io/projected/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-kube-api-access-t79ld\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493246    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493598 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493598 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493555    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.493872 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.493842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.495475 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.495451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.495582 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.495551    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.506289 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.506269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.515878 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.515858    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t79ld\" (UniqueName: \"kubernetes.io/projected/b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2-kube-api-access-t79ld\") pod \"maas-default-gateway-openshift-default-78bb78ff78-phcfn\" (UID: \"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.650084 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.649993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:25.792112 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.792086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"]
Jul 27 21:10:25.794330 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:10:25.794298    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bd6da4_d186_40b2_9a33_cdc8ad0c54e2.slice/crio-ae39929e84ca4784cc9f98ca624511f0ffeeef326eb7078ccb4e3b992fbdd5d6 WatchSource:0}: Error finding container ae39929e84ca4784cc9f98ca624511f0ffeeef326eb7078ccb4e3b992fbdd5d6: Status 404 returned error can't find the container with id ae39929e84ca4784cc9f98ca624511f0ffeeef326eb7078ccb4e3b992fbdd5d6
Jul 27 21:10:25.796450 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.796418    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:10:25.796548 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.796497    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:10:25.796619 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:25.796553    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:10:26.164075 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:26.164041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" event={"ID":"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2","Type":"ContainerStarted","Data":"11e38189712de1ca398d32352689a9745863e0c0f23020ff9da5b9f3bf7134c1"}
Jul 27 21:10:26.164319 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:26.164097    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" event={"ID":"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2","Type":"ContainerStarted","Data":"ae39929e84ca4784cc9f98ca624511f0ffeeef326eb7078ccb4e3b992fbdd5d6"}
Jul 27 21:10:26.187099 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:26.187041    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" podStartSLOduration=1.187021798 podStartE2EDuration="1.187021798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:26.186406522 +0000 UTC m=+770.452120641" watchObservedRunningTime="2026-07-27 21:10:26.187021798 +0000 UTC m=+770.452735915"
Jul 27 21:10:26.650921 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:26.650886    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:26.655376 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:26.655355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:27.168719 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.168692    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:27.169592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.169573    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:10:27.374718 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.374679    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"]
Jul 27 21:10:27.377152 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.377130    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:27.379517 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.379487    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 21:10:27.379517 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.379503    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lljbj\""
Jul 27 21:10:27.385914 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.385893    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"]
Jul 27 21:10:27.474896 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.474810    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"]
Jul 27 21:10:27.509992 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.509963    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-config-file\") pod \"limitador-limitador-64c94fd64f-mqn5t\" (UID: \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:27.510160 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.510033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjbvm\" (UniqueName: \"kubernetes.io/projected/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-kube-api-access-xjbvm\") pod \"limitador-limitador-64c94fd64f-mqn5t\" (UID: \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:27.611445 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.611407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-config-file\") pod \"limitador-limitador-64c94fd64f-mqn5t\" (UID: \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:27.611635 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.611481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjbvm\" (UniqueName: \"kubernetes.io/projected/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-kube-api-access-xjbvm\") pod \"limitador-limitador-64c94fd64f-mqn5t\" (UID: \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:27.612031 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.612012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-config-file\") pod \"limitador-limitador-64c94fd64f-mqn5t\" (UID: \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:27.619620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.619595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjbvm\" (UniqueName: \"kubernetes.io/projected/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-kube-api-access-xjbvm\") pod \"limitador-limitador-64c94fd64f-mqn5t\" (UID: \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:27.688545 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.688510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:27.829182 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:27.829153    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"]
Jul 27 21:10:27.830896 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:10:27.830869    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e3ae6c_4b76_451e_aa6e_3ccac045b4bc.slice/crio-611949941dc70ea55a6740626157a0421ac0fc6cc8cf7aeaa3530a459276bb43 WatchSource:0}: Error finding container 611949941dc70ea55a6740626157a0421ac0fc6cc8cf7aeaa3530a459276bb43: Status 404 returned error can't find the container with id 611949941dc70ea55a6740626157a0421ac0fc6cc8cf7aeaa3530a459276bb43
Jul 27 21:10:28.170452 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.170376    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ngjws"]
Jul 27 21:10:28.173505 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.173484    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ngjws"
Jul 27 21:10:28.175938 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.175919    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6qfkh\""
Jul 27 21:10:28.176830 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.176804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t" event={"ID":"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc","Type":"ContainerStarted","Data":"611949941dc70ea55a6740626157a0421ac0fc6cc8cf7aeaa3530a459276bb43"}
Jul 27 21:10:28.179563 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.179544    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ngjws"]
Jul 27 21:10:28.293694 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.293659    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4gh8m"]
Jul 27 21:10:28.295910 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.295894    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4gh8m"
Jul 27 21:10:28.303664 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.303641    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4gh8m"]
Jul 27 21:10:28.319204 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.319179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t884w\" (UniqueName: \"kubernetes.io/projected/0cd92c11-aa36-46a3-801b-fb9ba2405fb8-kube-api-access-t884w\") pod \"authorino-58cd955675-ngjws\" (UID: \"0cd92c11-aa36-46a3-801b-fb9ba2405fb8\") " pod="kuadrant-system/authorino-58cd955675-ngjws"
Jul 27 21:10:28.420266 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.420192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t884w\" (UniqueName: \"kubernetes.io/projected/0cd92c11-aa36-46a3-801b-fb9ba2405fb8-kube-api-access-t884w\") pod \"authorino-58cd955675-ngjws\" (UID: \"0cd92c11-aa36-46a3-801b-fb9ba2405fb8\") " pod="kuadrant-system/authorino-58cd955675-ngjws"
Jul 27 21:10:28.420451 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.420280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j8tb\" (UniqueName: \"kubernetes.io/projected/59c18bed-58b5-4503-9357-34426a4ce1d3-kube-api-access-9j8tb\") pod \"authorino-75d556bd77-4gh8m\" (UID: \"59c18bed-58b5-4503-9357-34426a4ce1d3\") " pod="kuadrant-system/authorino-75d556bd77-4gh8m"
Jul 27 21:10:28.429920 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.429855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t884w\" (UniqueName: \"kubernetes.io/projected/0cd92c11-aa36-46a3-801b-fb9ba2405fb8-kube-api-access-t884w\") pod \"authorino-58cd955675-ngjws\" (UID: \"0cd92c11-aa36-46a3-801b-fb9ba2405fb8\") " pod="kuadrant-system/authorino-58cd955675-ngjws"
Jul 27 21:10:28.484556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.484509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ngjws"
Jul 27 21:10:28.521078 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.521048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j8tb\" (UniqueName: \"kubernetes.io/projected/59c18bed-58b5-4503-9357-34426a4ce1d3-kube-api-access-9j8tb\") pod \"authorino-75d556bd77-4gh8m\" (UID: \"59c18bed-58b5-4503-9357-34426a4ce1d3\") " pod="kuadrant-system/authorino-75d556bd77-4gh8m"
Jul 27 21:10:28.529937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.529913    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j8tb\" (UniqueName: \"kubernetes.io/projected/59c18bed-58b5-4503-9357-34426a4ce1d3-kube-api-access-9j8tb\") pod \"authorino-75d556bd77-4gh8m\" (UID: \"59c18bed-58b5-4503-9357-34426a4ce1d3\") " pod="kuadrant-system/authorino-75d556bd77-4gh8m"
Jul 27 21:10:28.605412 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.605383    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4gh8m"
Jul 27 21:10:28.618909 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.618886    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ngjws"]
Jul 27 21:10:28.621420 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:10:28.621393    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cd92c11_aa36_46a3_801b_fb9ba2405fb8.slice/crio-6477403da2f8c7e4890d16bf610e8220c47f54019239ac95f79469764c4f44b9 WatchSource:0}: Error finding container 6477403da2f8c7e4890d16bf610e8220c47f54019239ac95f79469764c4f44b9: Status 404 returned error can't find the container with id 6477403da2f8c7e4890d16bf610e8220c47f54019239ac95f79469764c4f44b9
Jul 27 21:10:28.776981 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:28.776670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4gh8m"]
Jul 27 21:10:28.780438 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:10:28.780403    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59c18bed_58b5_4503_9357_34426a4ce1d3.slice/crio-ece8669b487b1dbcc536834e085b0b6c0e9ca7b01cce8aa7db2efe18e3c6ebca WatchSource:0}: Error finding container ece8669b487b1dbcc536834e085b0b6c0e9ca7b01cce8aa7db2efe18e3c6ebca: Status 404 returned error can't find the container with id ece8669b487b1dbcc536834e085b0b6c0e9ca7b01cce8aa7db2efe18e3c6ebca
Jul 27 21:10:29.184666 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:29.184624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ngjws" event={"ID":"0cd92c11-aa36-46a3-801b-fb9ba2405fb8","Type":"ContainerStarted","Data":"6477403da2f8c7e4890d16bf610e8220c47f54019239ac95f79469764c4f44b9"}
Jul 27 21:10:29.186278 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:29.186246    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4gh8m" event={"ID":"59c18bed-58b5-4503-9357-34426a4ce1d3","Type":"ContainerStarted","Data":"ece8669b487b1dbcc536834e085b0b6c0e9ca7b01cce8aa7db2efe18e3c6ebca"}
Jul 27 21:10:34.224177 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:34.224142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ngjws" event={"ID":"0cd92c11-aa36-46a3-801b-fb9ba2405fb8","Type":"ContainerStarted","Data":"8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de"}
Jul 27 21:10:34.225811 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:34.225777    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4gh8m" event={"ID":"59c18bed-58b5-4503-9357-34426a4ce1d3","Type":"ContainerStarted","Data":"a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7"}
Jul 27 21:10:34.227169 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:34.227147    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t" event={"ID":"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc","Type":"ContainerStarted","Data":"efdea56014d61a605f94683a7ee4213bdc3e488c5e36642f3b86ce67dc32a45a"}
Jul 27 21:10:34.227306 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:34.227272    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:34.257050 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:34.256998    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t" podStartSLOduration=1.901606385 podStartE2EDuration="7.256976568s" totalImagesPullingTime="5.355370183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:34.256496317 +0000 UTC m=+778.522210436" watchObservedRunningTime="2026-07-27 21:10:34.256976568 +0000 UTC m=+778.522690687"
Jul 27 21:10:34.258527 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:34.258481    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ngjws" podStartSLOduration=1.7000102990000001 podStartE2EDuration="6.258469156s" totalImagesPullingTime="4.558458857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:34.23826633 +0000 UTC m=+778.503980449" watchObservedRunningTime="2026-07-27 21:10:34.258469156 +0000 UTC m=+778.524183278"
Jul 27 21:10:34.270717 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:34.270660    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4gh8m" podStartSLOduration=1.902324006 podStartE2EDuration="6.270641161s" totalImagesPullingTime="4.368317155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:34.270384766 +0000 UTC m=+778.536098887" watchObservedRunningTime="2026-07-27 21:10:34.270641161 +0000 UTC m=+778.536355280"
Jul 27 21:10:34.297326 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:34.297295    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ngjws"]
Jul 27 21:10:36.237294 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:36.237238    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ngjws" podUID="0cd92c11-aa36-46a3-801b-fb9ba2405fb8" containerName="authorino" containerID="cri-o://8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de" gracePeriod=30
Jul 27 21:10:36.497265 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:36.497242    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ngjws"
Jul 27 21:10:36.595657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:36.595626    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t884w\" (UniqueName: \"kubernetes.io/projected/0cd92c11-aa36-46a3-801b-fb9ba2405fb8-kube-api-access-t884w\") pod \"0cd92c11-aa36-46a3-801b-fb9ba2405fb8\" (UID: \"0cd92c11-aa36-46a3-801b-fb9ba2405fb8\") "
Jul 27 21:10:36.597788 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:36.597757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd92c11-aa36-46a3-801b-fb9ba2405fb8-kube-api-access-t884w" (OuterVolumeSpecName: "kube-api-access-t884w") pod "0cd92c11-aa36-46a3-801b-fb9ba2405fb8" (UID: "0cd92c11-aa36-46a3-801b-fb9ba2405fb8"). InnerVolumeSpecName "kube-api-access-t884w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:10:36.696656 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:36.696562    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t884w\" (UniqueName: \"kubernetes.io/projected/0cd92c11-aa36-46a3-801b-fb9ba2405fb8-kube-api-access-t884w\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:10:37.242535 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.242501    2575 generic.go:356] "Generic (PLEG): container finished" podID="0cd92c11-aa36-46a3-801b-fb9ba2405fb8" containerID="8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de" exitCode=0
Jul 27 21:10:37.242925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.242548    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ngjws"
Jul 27 21:10:37.242925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.242591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ngjws" event={"ID":"0cd92c11-aa36-46a3-801b-fb9ba2405fb8","Type":"ContainerDied","Data":"8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de"}
Jul 27 21:10:37.242925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.242629    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ngjws" event={"ID":"0cd92c11-aa36-46a3-801b-fb9ba2405fb8","Type":"ContainerDied","Data":"6477403da2f8c7e4890d16bf610e8220c47f54019239ac95f79469764c4f44b9"}
Jul 27 21:10:37.242925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.242647    2575 scope.go:117] "RemoveContainer" containerID="8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de"
Jul 27 21:10:37.251430 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.251415    2575 scope.go:117] "RemoveContainer" containerID="8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de"
Jul 27 21:10:37.251687 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:10:37.251668    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de\": container with ID starting with 8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de not found: ID does not exist" containerID="8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de"
Jul 27 21:10:37.251737 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.251696    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de"} err="failed to get container status \"8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de\": rpc error: code = NotFound desc = could not find container \"8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de\": container with ID starting with 8d79e292d84efac1f901dab67f339ef356c0afe79dabb706f82f291800d5a9de not found: ID does not exist"
Jul 27 21:10:37.263135 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.263111    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ngjws"]
Jul 27 21:10:37.266378 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:37.266358    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ngjws"]
Jul 27 21:10:38.277845 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:38.277815    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd92c11-aa36-46a3-801b-fb9ba2405fb8" path="/var/lib/kubelet/pods/0cd92c11-aa36-46a3-801b-fb9ba2405fb8/volumes"
Jul 27 21:10:42.780415 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:42.780375    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"]
Jul 27 21:10:42.780977 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:42.780656    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t" podUID="e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc" containerName="limitador" containerID="cri-o://efdea56014d61a605f94683a7ee4213bdc3e488c5e36642f3b86ce67dc32a45a" gracePeriod=30
Jul 27 21:10:42.783183 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:42.783157    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:43.271599 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.271560    2575 generic.go:356] "Generic (PLEG): container finished" podID="e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc" containerID="efdea56014d61a605f94683a7ee4213bdc3e488c5e36642f3b86ce67dc32a45a" exitCode=0
Jul 27 21:10:43.271783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.271631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t" event={"ID":"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc","Type":"ContainerDied","Data":"efdea56014d61a605f94683a7ee4213bdc3e488c5e36642f3b86ce67dc32a45a"}
Jul 27 21:10:43.760102 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.760071    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:43.861545 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.861442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-config-file\") pod \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\" (UID: \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\") "
Jul 27 21:10:43.861545 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.861536    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjbvm\" (UniqueName: \"kubernetes.io/projected/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-kube-api-access-xjbvm\") pod \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\" (UID: \"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc\") "
Jul 27 21:10:43.862040 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.861895    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-config-file" (OuterVolumeSpecName: "config-file") pod "e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc" (UID: "e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:10:43.863738 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.863718    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-kube-api-access-xjbvm" (OuterVolumeSpecName: "kube-api-access-xjbvm") pod "e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc" (UID: "e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc"). InnerVolumeSpecName "kube-api-access-xjbvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:10:43.963053 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.963012    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjbvm\" (UniqueName: \"kubernetes.io/projected/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-kube-api-access-xjbvm\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:10:43.963053 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:43.963046    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc-config-file\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:10:44.277951 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:44.277922    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"
Jul 27 21:10:44.278134 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:44.277954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mqn5t" event={"ID":"e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc","Type":"ContainerDied","Data":"611949941dc70ea55a6740626157a0421ac0fc6cc8cf7aeaa3530a459276bb43"}
Jul 27 21:10:44.278134 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:44.278015    2575 scope.go:117] "RemoveContainer" containerID="efdea56014d61a605f94683a7ee4213bdc3e488c5e36642f3b86ce67dc32a45a"
Jul 27 21:10:44.302783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:44.302756    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"]
Jul 27 21:10:44.305143 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:44.305120    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mqn5t"]
Jul 27 21:10:46.278006 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:46.277969    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc" path="/var/lib/kubelet/pods/e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc/volumes"
Jul 27 21:10:49.146122 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.146089    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"]
Jul 27 21:10:49.146687 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.146670    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd92c11-aa36-46a3-801b-fb9ba2405fb8" containerName="authorino"
Jul 27 21:10:49.146733 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.146691    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd92c11-aa36-46a3-801b-fb9ba2405fb8" containerName="authorino"
Jul 27 21:10:49.146733 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.146717    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc" containerName="limitador"
Jul 27 21:10:49.146733 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.146725    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc" containerName="limitador"
Jul 27 21:10:49.146820 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.146810    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd92c11-aa36-46a3-801b-fb9ba2405fb8" containerName="authorino"
Jul 27 21:10:49.146855 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.146821    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e3ae6c-4b76-451e-aa6e-3ccac045b4bc" containerName="limitador"
Jul 27 21:10:49.151256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.151235    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:49.153822 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.153802    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 21:10:49.154597 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.154575    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vlpc6\""
Jul 27 21:10:49.154705 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.154620    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 21:10:49.154705 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.154620    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 21:10:49.158431 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.158405    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"]
Jul 27 21:10:49.212869 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.212836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71f0b7ad-712e-4dc1-a060-9fae97f187a9-data\") pod \"postgres-69fb4594cf-5mfr4\" (UID: \"71f0b7ad-712e-4dc1-a060-9fae97f187a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:49.213071 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.212878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77gbb\" (UniqueName: \"kubernetes.io/projected/71f0b7ad-712e-4dc1-a060-9fae97f187a9-kube-api-access-77gbb\") pod \"postgres-69fb4594cf-5mfr4\" (UID: \"71f0b7ad-712e-4dc1-a060-9fae97f187a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:49.314413 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.314374    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71f0b7ad-712e-4dc1-a060-9fae97f187a9-data\") pod \"postgres-69fb4594cf-5mfr4\" (UID: \"71f0b7ad-712e-4dc1-a060-9fae97f187a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:49.314570 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.314423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77gbb\" (UniqueName: \"kubernetes.io/projected/71f0b7ad-712e-4dc1-a060-9fae97f187a9-kube-api-access-77gbb\") pod \"postgres-69fb4594cf-5mfr4\" (UID: \"71f0b7ad-712e-4dc1-a060-9fae97f187a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:49.314845 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.314825    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/71f0b7ad-712e-4dc1-a060-9fae97f187a9-data\") pod \"postgres-69fb4594cf-5mfr4\" (UID: \"71f0b7ad-712e-4dc1-a060-9fae97f187a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:49.323525 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.323498    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77gbb\" (UniqueName: \"kubernetes.io/projected/71f0b7ad-712e-4dc1-a060-9fae97f187a9-kube-api-access-77gbb\") pod \"postgres-69fb4594cf-5mfr4\" (UID: \"71f0b7ad-712e-4dc1-a060-9fae97f187a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:49.462478 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.462362    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:49.596872 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:49.596753    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"]
Jul 27 21:10:49.599236 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:10:49.599184    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f0b7ad_712e_4dc1_a060_9fae97f187a9.slice/crio-299e5072e25217f6447abf7af787373ed31668988ff6a64a3165c3b1c2f6333c WatchSource:0}: Error finding container 299e5072e25217f6447abf7af787373ed31668988ff6a64a3165c3b1c2f6333c: Status 404 returned error can't find the container with id 299e5072e25217f6447abf7af787373ed31668988ff6a64a3165c3b1c2f6333c
Jul 27 21:10:50.307116 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:50.307077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4" event={"ID":"71f0b7ad-712e-4dc1-a060-9fae97f187a9","Type":"ContainerStarted","Data":"299e5072e25217f6447abf7af787373ed31668988ff6a64a3165c3b1c2f6333c"}
Jul 27 21:10:55.338433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:55.338381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4" event={"ID":"71f0b7ad-712e-4dc1-a060-9fae97f187a9","Type":"ContainerStarted","Data":"536cd01ff4f1782a10372e711599ffe50a805eea26b449f9b5645eeab5a21577"}
Jul 27 21:10:55.338822 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:55.338463    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:10:55.358076 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:10:55.358032    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4" podStartSLOduration=1.108728278 podStartE2EDuration="6.358016316s" totalImagesPullingTime="5.249288038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:10:55.357017666 +0000 UTC m=+799.622731784" watchObservedRunningTime="2026-07-27 21:10:55.358016316 +0000 UTC m=+799.623730432"
Jul 27 21:11:01.372351 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:01.372272    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5mfr4"
Jul 27 21:11:01.978492 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:01.978458    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8k65z"]
Jul 27 21:11:01.985329 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:01.985303    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8k65z"
Jul 27 21:11:01.988167 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:01.988146    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8k65z"]
Jul 27 21:11:02.019489 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.019462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfh26\" (UniqueName: \"kubernetes.io/projected/e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3-kube-api-access-pfh26\") pod \"authorino-5d4b67c446-8k65z\" (UID: \"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3\") " pod="kuadrant-system/authorino-5d4b67c446-8k65z"
Jul 27 21:11:02.120556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.120515    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfh26\" (UniqueName: \"kubernetes.io/projected/e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3-kube-api-access-pfh26\") pod \"authorino-5d4b67c446-8k65z\" (UID: \"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3\") " pod="kuadrant-system/authorino-5d4b67c446-8k65z"
Jul 27 21:11:02.131889 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.131857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfh26\" (UniqueName: \"kubernetes.io/projected/e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3-kube-api-access-pfh26\") pod \"authorino-5d4b67c446-8k65z\" (UID: \"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3\") " pod="kuadrant-system/authorino-5d4b67c446-8k65z"
Jul 27 21:11:02.247044 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.247017    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8k65z"]
Jul 27 21:11:02.247298 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.247286    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8k65z"
Jul 27 21:11:02.281663 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.281623    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ff668b79b-5pltf"]
Jul 27 21:11:02.285841 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.285819    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff668b79b-5pltf"
Jul 27 21:11:02.294972 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.294620    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff668b79b-5pltf"]
Jul 27 21:11:02.321789 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.321740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx9ct\" (UniqueName: \"kubernetes.io/projected/16d53b97-cd1d-47cf-aa3a-2d5f89bec812-kube-api-access-xx9ct\") pod \"authorino-7ff668b79b-5pltf\" (UID: \"16d53b97-cd1d-47cf-aa3a-2d5f89bec812\") " pod="kuadrant-system/authorino-7ff668b79b-5pltf"
Jul 27 21:11:02.385195 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.385175    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8k65z"]
Jul 27 21:11:02.387737 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:11:02.387711    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5d9a1ac_3ff0_41c3_a890_7cd90635f0d3.slice/crio-9745794ad170550fc0b05613726db1eba62d19d596c126192920acfdf7c49620 WatchSource:0}: Error finding container 9745794ad170550fc0b05613726db1eba62d19d596c126192920acfdf7c49620: Status 404 returned error can't find the container with id 9745794ad170550fc0b05613726db1eba62d19d596c126192920acfdf7c49620
Jul 27 21:11:02.423014 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.422983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx9ct\" (UniqueName: \"kubernetes.io/projected/16d53b97-cd1d-47cf-aa3a-2d5f89bec812-kube-api-access-xx9ct\") pod \"authorino-7ff668b79b-5pltf\" (UID: \"16d53b97-cd1d-47cf-aa3a-2d5f89bec812\") " pod="kuadrant-system/authorino-7ff668b79b-5pltf"
Jul 27 21:11:02.432876 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.432840    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx9ct\" (UniqueName: \"kubernetes.io/projected/16d53b97-cd1d-47cf-aa3a-2d5f89bec812-kube-api-access-xx9ct\") pod \"authorino-7ff668b79b-5pltf\" (UID: \"16d53b97-cd1d-47cf-aa3a-2d5f89bec812\") " pod="kuadrant-system/authorino-7ff668b79b-5pltf"
Jul 27 21:11:02.516842 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.516764    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff668b79b-5pltf"]
Jul 27 21:11:02.517021 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.517009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff668b79b-5pltf"
Jul 27 21:11:02.545388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.545359    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5db67656d8-jch24"]
Jul 27 21:11:02.549015 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.548998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:11:02.551729 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.551705    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 21:11:02.559114 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.559046    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db67656d8-jch24"]
Jul 27 21:11:02.625193 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.625155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lj2v\" (UniqueName: \"kubernetes.io/projected/a852e322-895f-4fc6-9287-f259e53cc9a3-kube-api-access-8lj2v\") pod \"authorino-5db67656d8-jch24\" (UID: \"a852e322-895f-4fc6-9287-f259e53cc9a3\") " pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:11:02.625356 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.625225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a852e322-895f-4fc6-9287-f259e53cc9a3-tls-cert\") pod \"authorino-5db67656d8-jch24\" (UID: \"a852e322-895f-4fc6-9287-f259e53cc9a3\") " pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:11:02.656111 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.656049    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff668b79b-5pltf"]
Jul 27 21:11:02.658340 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:11:02.658309    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16d53b97_cd1d_47cf_aa3a_2d5f89bec812.slice/crio-64a9c1ae2ab9a2c4df39d887457588e68b043d794fb5011931b2208c850327d6 WatchSource:0}: Error finding container 64a9c1ae2ab9a2c4df39d887457588e68b043d794fb5011931b2208c850327d6: Status 404 returned error can't find the container with id 64a9c1ae2ab9a2c4df39d887457588e68b043d794fb5011931b2208c850327d6
Jul 27 21:11:02.725660 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.725632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a852e322-895f-4fc6-9287-f259e53cc9a3-tls-cert\") pod \"authorino-5db67656d8-jch24\" (UID: \"a852e322-895f-4fc6-9287-f259e53cc9a3\") " pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:11:02.725762 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.725726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lj2v\" (UniqueName: \"kubernetes.io/projected/a852e322-895f-4fc6-9287-f259e53cc9a3-kube-api-access-8lj2v\") pod \"authorino-5db67656d8-jch24\" (UID: \"a852e322-895f-4fc6-9287-f259e53cc9a3\") " pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:11:02.728171 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.728150    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a852e322-895f-4fc6-9287-f259e53cc9a3-tls-cert\") pod \"authorino-5db67656d8-jch24\" (UID: \"a852e322-895f-4fc6-9287-f259e53cc9a3\") " pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:11:02.734062 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.734044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lj2v\" (UniqueName: \"kubernetes.io/projected/a852e322-895f-4fc6-9287-f259e53cc9a3-kube-api-access-8lj2v\") pod \"authorino-5db67656d8-jch24\" (UID: \"a852e322-895f-4fc6-9287-f259e53cc9a3\") " pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:11:02.858789 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.858758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:11:02.992697 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:02.992675    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5db67656d8-jch24"]
Jul 27 21:11:02.994968 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:11:02.994940    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda852e322_895f_4fc6_9287_f259e53cc9a3.slice/crio-f7d92823a6bc3068a1df16e7fc88233b292c20084cba6861f7d66d5b33c4b9fe WatchSource:0}: Error finding container f7d92823a6bc3068a1df16e7fc88233b292c20084cba6861f7d66d5b33c4b9fe: Status 404 returned error can't find the container with id f7d92823a6bc3068a1df16e7fc88233b292c20084cba6861f7d66d5b33c4b9fe
Jul 27 21:11:03.379202 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.379175    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db67656d8-jch24" event={"ID":"a852e322-895f-4fc6-9287-f259e53cc9a3","Type":"ContainerStarted","Data":"823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27"}
Jul 27 21:11:03.379361 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.379249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db67656d8-jch24" event={"ID":"a852e322-895f-4fc6-9287-f259e53cc9a3","Type":"ContainerStarted","Data":"f7d92823a6bc3068a1df16e7fc88233b292c20084cba6861f7d66d5b33c4b9fe"}
Jul 27 21:11:03.380978 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.380954    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7ff668b79b-5pltf" podUID="16d53b97-cd1d-47cf-aa3a-2d5f89bec812" containerName="authorino" containerID="cri-o://ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc" gracePeriod=30
Jul 27 21:11:03.380978 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.380951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff668b79b-5pltf" event={"ID":"16d53b97-cd1d-47cf-aa3a-2d5f89bec812","Type":"ContainerStarted","Data":"ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc"}
Jul 27 21:11:03.381181 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.381006    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff668b79b-5pltf" event={"ID":"16d53b97-cd1d-47cf-aa3a-2d5f89bec812","Type":"ContainerStarted","Data":"64a9c1ae2ab9a2c4df39d887457588e68b043d794fb5011931b2208c850327d6"}
Jul 27 21:11:03.383031 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.383005    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8k65z" event={"ID":"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3","Type":"ContainerStarted","Data":"cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454"}
Jul 27 21:11:03.383130 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.383044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8k65z" event={"ID":"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3","Type":"ContainerStarted","Data":"9745794ad170550fc0b05613726db1eba62d19d596c126192920acfdf7c49620"}
Jul 27 21:11:03.383130 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.383094    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8k65z" podUID="e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3" containerName="authorino" containerID="cri-o://cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454" gracePeriod=30
Jul 27 21:11:03.395490 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.395434    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5db67656d8-jch24" podStartSLOduration=1.090087649 podStartE2EDuration="1.395412627s" totalImagesPullingTime="305.324978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:03.393427735 +0000 UTC m=+807.659141853" watchObservedRunningTime="2026-07-27 21:11:03.395412627 +0000 UTC m=+807.661126745"
Jul 27 21:11:03.408482 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.408421    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8k65z" podStartSLOduration=2.086376572 podStartE2EDuration="2.408398863s" totalImagesPullingTime="322.022291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:03.407851732 +0000 UTC m=+807.673565850" watchObservedRunningTime="2026-07-27 21:11:03.408398863 +0000 UTC m=+807.674112982"
Jul 27 21:11:03.424119 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.424059    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4gh8m"]
Jul 27 21:11:03.424665 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.424403    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4gh8m" podUID="59c18bed-58b5-4503-9357-34426a4ce1d3" containerName="authorino" containerID="cri-o://a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7" gracePeriod=30
Jul 27 21:11:03.425432 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.425386    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ff668b79b-5pltf" podStartSLOduration=1.027903119 podStartE2EDuration="1.425364975s" totalImagesPullingTime="397.461856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:03.424414452 +0000 UTC m=+807.690128570" watchObservedRunningTime="2026-07-27 21:11:03.425364975 +0000 UTC m=+807.691079095"
Jul 27 21:11:03.680596 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.680570    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8k65z"
Jul 27 21:11:03.713708 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.713683    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff668b79b-5pltf"
Jul 27 21:11:03.719333 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.719309    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4gh8m"
Jul 27 21:11:03.735489 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.735461    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfh26\" (UniqueName: \"kubernetes.io/projected/e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3-kube-api-access-pfh26\") pod \"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3\" (UID: \"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3\") "
Jul 27 21:11:03.735636 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.735605    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx9ct\" (UniqueName: \"kubernetes.io/projected/16d53b97-cd1d-47cf-aa3a-2d5f89bec812-kube-api-access-xx9ct\") pod \"16d53b97-cd1d-47cf-aa3a-2d5f89bec812\" (UID: \"16d53b97-cd1d-47cf-aa3a-2d5f89bec812\") "
Jul 27 21:11:03.737829 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.737803    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3-kube-api-access-pfh26" (OuterVolumeSpecName: "kube-api-access-pfh26") pod "e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3" (UID: "e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3"). InnerVolumeSpecName "kube-api-access-pfh26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:11:03.738239 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.738192    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16d53b97-cd1d-47cf-aa3a-2d5f89bec812-kube-api-access-xx9ct" (OuterVolumeSpecName: "kube-api-access-xx9ct") pod "16d53b97-cd1d-47cf-aa3a-2d5f89bec812" (UID: "16d53b97-cd1d-47cf-aa3a-2d5f89bec812"). InnerVolumeSpecName "kube-api-access-xx9ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:11:03.836911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.836877    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j8tb\" (UniqueName: \"kubernetes.io/projected/59c18bed-58b5-4503-9357-34426a4ce1d3-kube-api-access-9j8tb\") pod \"59c18bed-58b5-4503-9357-34426a4ce1d3\" (UID: \"59c18bed-58b5-4503-9357-34426a4ce1d3\") "
Jul 27 21:11:03.837090 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.837033    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx9ct\" (UniqueName: \"kubernetes.io/projected/16d53b97-cd1d-47cf-aa3a-2d5f89bec812-kube-api-access-xx9ct\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:11:03.837090 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.837047    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfh26\" (UniqueName: \"kubernetes.io/projected/e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3-kube-api-access-pfh26\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:11:03.839116 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.839092    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c18bed-58b5-4503-9357-34426a4ce1d3-kube-api-access-9j8tb" (OuterVolumeSpecName: "kube-api-access-9j8tb") pod "59c18bed-58b5-4503-9357-34426a4ce1d3" (UID: "59c18bed-58b5-4503-9357-34426a4ce1d3"). InnerVolumeSpecName "kube-api-access-9j8tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:11:03.937673 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:03.937583    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j8tb\" (UniqueName: \"kubernetes.io/projected/59c18bed-58b5-4503-9357-34426a4ce1d3-kube-api-access-9j8tb\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:11:04.388459 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.388418    2575 generic.go:356] "Generic (PLEG): container finished" podID="16d53b97-cd1d-47cf-aa3a-2d5f89bec812" containerID="ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc" exitCode=0
Jul 27 21:11:04.388671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.388480    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff668b79b-5pltf"
Jul 27 21:11:04.388671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.388514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff668b79b-5pltf" event={"ID":"16d53b97-cd1d-47cf-aa3a-2d5f89bec812","Type":"ContainerDied","Data":"ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc"}
Jul 27 21:11:04.388671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.388564    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff668b79b-5pltf" event={"ID":"16d53b97-cd1d-47cf-aa3a-2d5f89bec812","Type":"ContainerDied","Data":"64a9c1ae2ab9a2c4df39d887457588e68b043d794fb5011931b2208c850327d6"}
Jul 27 21:11:04.388671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.388585    2575 scope.go:117] "RemoveContainer" containerID="ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc"
Jul 27 21:11:04.390042 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.389857    2575 generic.go:356] "Generic (PLEG): container finished" podID="59c18bed-58b5-4503-9357-34426a4ce1d3" containerID="a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7" exitCode=0
Jul 27 21:11:04.390042 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.389907    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4gh8m"
Jul 27 21:11:04.390042 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.389941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4gh8m" event={"ID":"59c18bed-58b5-4503-9357-34426a4ce1d3","Type":"ContainerDied","Data":"a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7"}
Jul 27 21:11:04.390042 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.389979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4gh8m" event={"ID":"59c18bed-58b5-4503-9357-34426a4ce1d3","Type":"ContainerDied","Data":"ece8669b487b1dbcc536834e085b0b6c0e9ca7b01cce8aa7db2efe18e3c6ebca"}
Jul 27 21:11:04.391464 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.391440    2575 generic.go:356] "Generic (PLEG): container finished" podID="e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3" containerID="cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454" exitCode=0
Jul 27 21:11:04.391584 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.391500    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8k65z"
Jul 27 21:11:04.391584 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.391531    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8k65z" event={"ID":"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3","Type":"ContainerDied","Data":"cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454"}
Jul 27 21:11:04.391584 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.391562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8k65z" event={"ID":"e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3","Type":"ContainerDied","Data":"9745794ad170550fc0b05613726db1eba62d19d596c126192920acfdf7c49620"}
Jul 27 21:11:04.398434 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.398415    2575 scope.go:117] "RemoveContainer" containerID="ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc"
Jul 27 21:11:04.398698 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:11:04.398663    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc\": container with ID starting with ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc not found: ID does not exist" containerID="ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc"
Jul 27 21:11:04.398698 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.398685    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc"} err="failed to get container status \"ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc\": rpc error: code = NotFound desc = could not find container \"ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc\": container with ID starting with ce023e322b33a393b61250a84738cc94c0e97a8b9601e125ab9ed2a0349196dc not found: ID does not exist"
Jul 27 21:11:04.398791 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.398700    2575 scope.go:117] "RemoveContainer" containerID="a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7"
Jul 27 21:11:04.406632 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.406615    2575 scope.go:117] "RemoveContainer" containerID="a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7"
Jul 27 21:11:04.406880 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:11:04.406861    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7\": container with ID starting with a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7 not found: ID does not exist" containerID="a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7"
Jul 27 21:11:04.406950 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.406889    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7"} err="failed to get container status \"a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7\": rpc error: code = NotFound desc = could not find container \"a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7\": container with ID starting with a2edf16ad7615e0225949120c9a16188236a0d3df6dcf26d16350506dff6aed7 not found: ID does not exist"
Jul 27 21:11:04.406950 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.406912    2575 scope.go:117] "RemoveContainer" containerID="cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454"
Jul 27 21:11:04.412181 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.412160    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4gh8m"]
Jul 27 21:11:04.414496 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.414480    2575 scope.go:117] "RemoveContainer" containerID="cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454"
Jul 27 21:11:04.414799 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:11:04.414777    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454\": container with ID starting with cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454 not found: ID does not exist" containerID="cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454"
Jul 27 21:11:04.414902 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.414805    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454"} err="failed to get container status \"cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454\": rpc error: code = NotFound desc = could not find container \"cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454\": container with ID starting with cff1dad2e829fade05a008fc70c65af0ede28f283328585182194912ec096454 not found: ID does not exist"
Jul 27 21:11:04.416848 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.416827    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4gh8m"]
Jul 27 21:11:04.426799 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.426782    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8k65z"]
Jul 27 21:11:04.430560 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.430539    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8k65z"]
Jul 27 21:11:04.441273 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.441251    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff668b79b-5pltf"]
Jul 27 21:11:04.445445 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:04.445422    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7ff668b79b-5pltf"]
Jul 27 21:11:06.278135 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:06.278100    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16d53b97-cd1d-47cf-aa3a-2d5f89bec812" path="/var/lib/kubelet/pods/16d53b97-cd1d-47cf-aa3a-2d5f89bec812/volumes"
Jul 27 21:11:06.278525 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:06.278457    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c18bed-58b5-4503-9357-34426a4ce1d3" path="/var/lib/kubelet/pods/59c18bed-58b5-4503-9357-34426a4ce1d3/volumes"
Jul 27 21:11:06.278729 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:06.278716    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3" path="/var/lib/kubelet/pods/e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3/volumes"
Jul 27 21:11:08.426703 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.426666    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b78f8fb5c-kk9zw"]
Jul 27 21:11:08.427108 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427013    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3" containerName="authorino"
Jul 27 21:11:08.427108 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427023    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3" containerName="authorino"
Jul 27 21:11:08.427108 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427044    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c18bed-58b5-4503-9357-34426a4ce1d3" containerName="authorino"
Jul 27 21:11:08.427108 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427050    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c18bed-58b5-4503-9357-34426a4ce1d3" containerName="authorino"
Jul 27 21:11:08.427108 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427062    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16d53b97-cd1d-47cf-aa3a-2d5f89bec812" containerName="authorino"
Jul 27 21:11:08.427108 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427067    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16d53b97-cd1d-47cf-aa3a-2d5f89bec812" containerName="authorino"
Jul 27 21:11:08.427343 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427118    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c18bed-58b5-4503-9357-34426a4ce1d3" containerName="authorino"
Jul 27 21:11:08.427343 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427127    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d9a1ac-3ff0-41c3-a890-7cd90635f0d3" containerName="authorino"
Jul 27 21:11:08.427343 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.427134    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="16d53b97-cd1d-47cf-aa3a-2d5f89bec812" containerName="authorino"
Jul 27 21:11:08.432286 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.432268    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:08.435242 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.435196    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nlmph\""
Jul 27 21:11:08.435363 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.435198    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 21:11:08.435363 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.435247    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 21:11:08.441789 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.441765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b78f8fb5c-kk9zw"]
Jul 27 21:11:08.479841 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.479807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sgq5\" (UniqueName: \"kubernetes.io/projected/b2d581f7-cefe-4c91-b576-d2f750974e99-kube-api-access-6sgq5\") pod \"maas-controller-6b78f8fb5c-kk9zw\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") " pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:08.480031 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.479851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert\") pod \"maas-controller-6b78f8fb5c-kk9zw\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") " pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:08.581273 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.581200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert\") pod \"maas-controller-6b78f8fb5c-kk9zw\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") " pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:08.581483 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.581341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sgq5\" (UniqueName: \"kubernetes.io/projected/b2d581f7-cefe-4c91-b576-d2f750974e99-kube-api-access-6sgq5\") pod \"maas-controller-6b78f8fb5c-kk9zw\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") " pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:08.581483 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:11:08.581350    2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 27 21:11:08.581483 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:11:08.581413    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert podName:b2d581f7-cefe-4c91-b576-d2f750974e99 nodeName:}" failed. No retries permitted until 2026-07-27 21:11:09.081398069 +0000 UTC m=+813.347112166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert") pod "maas-controller-6b78f8fb5c-kk9zw" (UID: "b2d581f7-cefe-4c91-b576-d2f750974e99") : secret "maas-controller-webhook-cert" not found
Jul 27 21:11:08.590327 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.590296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sgq5\" (UniqueName: \"kubernetes.io/projected/b2d581f7-cefe-4c91-b576-d2f750974e99-kube-api-access-6sgq5\") pod \"maas-controller-6b78f8fb5c-kk9zw\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") " pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:08.611835 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.611803    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6574497c9c-rzt2f"]
Jul 27 21:11:08.614007 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.613987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:08.624379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.624353    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6574497c9c-rzt2f"]
Jul 27 21:11:08.682085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.681993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt45p\" (UniqueName: \"kubernetes.io/projected/76cba085-ac03-4fbe-8962-3cd6b6c5819a-kube-api-access-zt45p\") pod \"maas-controller-6574497c9c-rzt2f\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") " pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:08.682085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.682075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert\") pod \"maas-controller-6574497c9c-rzt2f\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") " pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:08.782761 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.782730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt45p\" (UniqueName: \"kubernetes.io/projected/76cba085-ac03-4fbe-8962-3cd6b6c5819a-kube-api-access-zt45p\") pod \"maas-controller-6574497c9c-rzt2f\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") " pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:08.782941 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.782792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert\") pod \"maas-controller-6574497c9c-rzt2f\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") " pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:08.782941 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:11:08.782906    2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 27 21:11:08.783016 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:11:08.782964    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert podName:76cba085-ac03-4fbe-8962-3cd6b6c5819a nodeName:}" failed. No retries permitted until 2026-07-27 21:11:09.282947013 +0000 UTC m=+813.548661109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert") pod "maas-controller-6574497c9c-rzt2f" (UID: "76cba085-ac03-4fbe-8962-3cd6b6c5819a") : secret "maas-controller-webhook-cert" not found
Jul 27 21:11:08.791123 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:08.791095    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt45p\" (UniqueName: \"kubernetes.io/projected/76cba085-ac03-4fbe-8962-3cd6b6c5819a-kube-api-access-zt45p\") pod \"maas-controller-6574497c9c-rzt2f\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") " pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:09.086420 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:09.086382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert\") pod \"maas-controller-6b78f8fb5c-kk9zw\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") " pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:09.088965 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:09.088942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert\") pod \"maas-controller-6b78f8fb5c-kk9zw\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") " pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:09.288228 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:09.288186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert\") pod \"maas-controller-6574497c9c-rzt2f\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") " pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:09.290752 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:09.290729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert\") pod \"maas-controller-6574497c9c-rzt2f\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") " pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:09.345111 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:09.345029    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:09.480262 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:09.480156    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b78f8fb5c-kk9zw"]
Jul 27 21:11:09.482621 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:11:09.482594    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d581f7_cefe_4c91_b576_d2f750974e99.slice/crio-39a05bea6bad44de3c8f4febbec3a55785d7eb06b766b9f013c348bd679bf62f WatchSource:0}: Error finding container 39a05bea6bad44de3c8f4febbec3a55785d7eb06b766b9f013c348bd679bf62f: Status 404 returned error can't find the container with id 39a05bea6bad44de3c8f4febbec3a55785d7eb06b766b9f013c348bd679bf62f
Jul 27 21:11:09.526287 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:09.526233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:09.659880 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:09.659852    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6574497c9c-rzt2f"]
Jul 27 21:11:09.662169 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:11:09.662145    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76cba085_ac03_4fbe_8962_3cd6b6c5819a.slice/crio-716046154dae680dd0fe26dedf925ad35862f3df557d537c8c0a3d9ae20bf118 WatchSource:0}: Error finding container 716046154dae680dd0fe26dedf925ad35862f3df557d537c8c0a3d9ae20bf118: Status 404 returned error can't find the container with id 716046154dae680dd0fe26dedf925ad35862f3df557d537c8c0a3d9ae20bf118
Jul 27 21:11:10.432956 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:10.432916    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw" event={"ID":"b2d581f7-cefe-4c91-b576-d2f750974e99","Type":"ContainerStarted","Data":"39a05bea6bad44de3c8f4febbec3a55785d7eb06b766b9f013c348bd679bf62f"}
Jul 27 21:11:10.436973 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:10.436941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-rzt2f" event={"ID":"76cba085-ac03-4fbe-8962-3cd6b6c5819a","Type":"ContainerStarted","Data":"716046154dae680dd0fe26dedf925ad35862f3df557d537c8c0a3d9ae20bf118"}
Jul 27 21:11:12.449545 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:12.449452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw" event={"ID":"b2d581f7-cefe-4c91-b576-d2f750974e99","Type":"ContainerStarted","Data":"97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485"}
Jul 27 21:11:12.449980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:12.449560    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:12.451171 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:12.451144    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-rzt2f" event={"ID":"76cba085-ac03-4fbe-8962-3cd6b6c5819a","Type":"ContainerStarted","Data":"8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365"}
Jul 27 21:11:12.451306 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:12.451236    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:12.469093 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:12.469043    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw" podStartSLOduration=1.9048456379999998 podStartE2EDuration="4.469028862s" totalImagesPullingTime="2.564183224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:12.467345552 +0000 UTC m=+816.733059670" watchObservedRunningTime="2026-07-27 21:11:12.469028862 +0000 UTC m=+816.734742980"
Jul 27 21:11:12.487645 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:12.487599    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6574497c9c-rzt2f" podStartSLOduration=2.09374637 podStartE2EDuration="4.487582675s" totalImagesPullingTime="2.393836305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:12.485827404 +0000 UTC m=+816.751541523" watchObservedRunningTime="2026-07-27 21:11:12.487582675 +0000 UTC m=+816.753296793"
Jul 27 21:11:23.458960 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.458925    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:23.459433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.459112    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:11:23.517693 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.517655    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b78f8fb5c-kk9zw"]
Jul 27 21:11:23.517921 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.517890    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw" podUID="b2d581f7-cefe-4c91-b576-d2f750974e99" containerName="manager" containerID="cri-o://97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485" gracePeriod=30
Jul 27 21:11:23.775048 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.775021    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:23.925062 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.925019    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sgq5\" (UniqueName: \"kubernetes.io/projected/b2d581f7-cefe-4c91-b576-d2f750974e99-kube-api-access-6sgq5\") pod \"b2d581f7-cefe-4c91-b576-d2f750974e99\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") "
Jul 27 21:11:23.925266 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.925090    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert\") pod \"b2d581f7-cefe-4c91-b576-d2f750974e99\" (UID: \"b2d581f7-cefe-4c91-b576-d2f750974e99\") "
Jul 27 21:11:23.927452 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.927414    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d581f7-cefe-4c91-b576-d2f750974e99-kube-api-access-6sgq5" (OuterVolumeSpecName: "kube-api-access-6sgq5") pod "b2d581f7-cefe-4c91-b576-d2f750974e99" (UID: "b2d581f7-cefe-4c91-b576-d2f750974e99"). InnerVolumeSpecName "kube-api-access-6sgq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:11:23.927546 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:23.927490    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b2d581f7-cefe-4c91-b576-d2f750974e99" (UID: "b2d581f7-cefe-4c91-b576-d2f750974e99"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:11:24.025822 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.025730    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sgq5\" (UniqueName: \"kubernetes.io/projected/b2d581f7-cefe-4c91-b576-d2f750974e99-kube-api-access-6sgq5\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:11:24.025822 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.025763    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2d581f7-cefe-4c91-b576-d2f750974e99-webhook-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:11:24.512309 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.512275    2575 generic.go:356] "Generic (PLEG): container finished" podID="b2d581f7-cefe-4c91-b576-d2f750974e99" containerID="97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485" exitCode=0
Jul 27 21:11:24.512744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.512338    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw"
Jul 27 21:11:24.512744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.512367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw" event={"ID":"b2d581f7-cefe-4c91-b576-d2f750974e99","Type":"ContainerDied","Data":"97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485"}
Jul 27 21:11:24.512744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.512424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b78f8fb5c-kk9zw" event={"ID":"b2d581f7-cefe-4c91-b576-d2f750974e99","Type":"ContainerDied","Data":"39a05bea6bad44de3c8f4febbec3a55785d7eb06b766b9f013c348bd679bf62f"}
Jul 27 21:11:24.512744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.512447    2575 scope.go:117] "RemoveContainer" containerID="97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485"
Jul 27 21:11:24.521980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.521835    2575 scope.go:117] "RemoveContainer" containerID="97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485"
Jul 27 21:11:24.522130 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:11:24.522108    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485\": container with ID starting with 97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485 not found: ID does not exist" containerID="97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485"
Jul 27 21:11:24.522263 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.522147    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485"} err="failed to get container status \"97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485\": rpc error: code = NotFound desc = could not find container \"97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485\": container with ID starting with 97aa7d943a34e234aa4cf53f952398ef25c211df709f3c99f4cf60e8e9888485 not found: ID does not exist"
Jul 27 21:11:24.532800 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.532775    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b78f8fb5c-kk9zw"]
Jul 27 21:11:24.536424 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:24.536368    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b78f8fb5c-kk9zw"]
Jul 27 21:11:26.278010 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:26.277973    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d581f7-cefe-4c91-b576-d2f750974e99" path="/var/lib/kubelet/pods/b2d581f7-cefe-4c91-b576-d2f750974e99/volumes"
Jul 27 21:11:44.650996 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.650957    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"]
Jul 27 21:11:44.651538 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.651521    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d581f7-cefe-4c91-b576-d2f750974e99" containerName="manager"
Jul 27 21:11:44.651581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.651541    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d581f7-cefe-4c91-b576-d2f750974e99" containerName="manager"
Jul 27 21:11:44.651661 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.651651    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d581f7-cefe-4c91-b576-d2f750974e99" containerName="manager"
Jul 27 21:11:44.660290 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.660270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.663765 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.663735    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"]
Jul 27 21:11:44.665106 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.665081    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gdtk\""
Jul 27 21:11:44.665106 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.665103    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 27 21:11:44.713815 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.713780    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96bcd295-4cb8-4415-b149-75f41b834f1b-maas-api-tls\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.713991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.713893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96bcd295-4cb8-4415-b149-75f41b834f1b-openshift-service-ca\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.713991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.713922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmwl\" (UniqueName: \"kubernetes.io/projected/96bcd295-4cb8-4415-b149-75f41b834f1b-kube-api-access-dkmwl\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.814748 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.814709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96bcd295-4cb8-4415-b149-75f41b834f1b-maas-api-tls\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.814945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.814812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96bcd295-4cb8-4415-b149-75f41b834f1b-openshift-service-ca\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.814945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.814836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmwl\" (UniqueName: \"kubernetes.io/projected/96bcd295-4cb8-4415-b149-75f41b834f1b-kube-api-access-dkmwl\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.815447 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.815427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96bcd295-4cb8-4415-b149-75f41b834f1b-openshift-service-ca\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.817268 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.817251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96bcd295-4cb8-4415-b149-75f41b834f1b-maas-api-tls\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.823326 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.823302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmwl\" (UniqueName: \"kubernetes.io/projected/96bcd295-4cb8-4415-b149-75f41b834f1b-kube-api-access-dkmwl\") pod \"maas-api-847d547f49-2mkd7\" (UID: \"96bcd295-4cb8-4415-b149-75f41b834f1b\") " pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:44.972090 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:44.972010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:45.117990 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.117965    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"]
Jul 27 21:11:45.120260 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:11:45.120230    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bcd295_4cb8_4415_b149_75f41b834f1b.slice/crio-91fd2e1694bdad1ab11df5cedc5578311d40acbb6eaf648a472660cfd35b45e7 WatchSource:0}: Error finding container 91fd2e1694bdad1ab11df5cedc5578311d40acbb6eaf648a472660cfd35b45e7: Status 404 returned error can't find the container with id 91fd2e1694bdad1ab11df5cedc5578311d40acbb6eaf648a472660cfd35b45e7
Jul 27 21:11:45.185869 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.185831    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"]
Jul 27 21:11:45.190915 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.190892    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:45.193635 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.193616    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 21:11:45.201567 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.201533    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"]
Jul 27 21:11:45.218866 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.218829    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea6e2f50-66b2-47ba-8e2b-313f8119dbf8-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zt2gn\" (UID: \"ea6e2f50-66b2-47ba-8e2b-313f8119dbf8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:45.219026 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.218882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffnt\" (UniqueName: \"kubernetes.io/projected/ea6e2f50-66b2-47ba-8e2b-313f8119dbf8-kube-api-access-cffnt\") pod \"payload-pre-processing-687dbb6cf6-zt2gn\" (UID: \"ea6e2f50-66b2-47ba-8e2b-313f8119dbf8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:45.226347 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.226279    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-kf4pz"]
Jul 27 21:11:45.230776 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.230750    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:45.233561 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.233536    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-kf4pz"]
Jul 27 21:11:45.237102 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.237077    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kgv88\""
Jul 27 21:11:45.319701 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.319669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0665b62-bc6b-499c-82bd-72fc41782826-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-kf4pz\" (UID: \"a0665b62-bc6b-499c-82bd-72fc41782826\") " pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:45.319885 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.319718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea6e2f50-66b2-47ba-8e2b-313f8119dbf8-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zt2gn\" (UID: \"ea6e2f50-66b2-47ba-8e2b-313f8119dbf8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:45.319885 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.319747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffnt\" (UniqueName: \"kubernetes.io/projected/ea6e2f50-66b2-47ba-8e2b-313f8119dbf8-kube-api-access-cffnt\") pod \"payload-pre-processing-687dbb6cf6-zt2gn\" (UID: \"ea6e2f50-66b2-47ba-8e2b-313f8119dbf8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:45.320122 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.319885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh8ld\" (UniqueName: \"kubernetes.io/projected/a0665b62-bc6b-499c-82bd-72fc41782826-kube-api-access-bh8ld\") pod \"payload-processing-5cc6cd444b-kf4pz\" (UID: \"a0665b62-bc6b-499c-82bd-72fc41782826\") " pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:45.320764 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.320741    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea6e2f50-66b2-47ba-8e2b-313f8119dbf8-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zt2gn\" (UID: \"ea6e2f50-66b2-47ba-8e2b-313f8119dbf8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:45.330935 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.330901    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffnt\" (UniqueName: \"kubernetes.io/projected/ea6e2f50-66b2-47ba-8e2b-313f8119dbf8-kube-api-access-cffnt\") pod \"payload-pre-processing-687dbb6cf6-zt2gn\" (UID: \"ea6e2f50-66b2-47ba-8e2b-313f8119dbf8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:45.421064 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.421032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh8ld\" (UniqueName: \"kubernetes.io/projected/a0665b62-bc6b-499c-82bd-72fc41782826-kube-api-access-bh8ld\") pod \"payload-processing-5cc6cd444b-kf4pz\" (UID: \"a0665b62-bc6b-499c-82bd-72fc41782826\") " pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:45.421262 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.421079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0665b62-bc6b-499c-82bd-72fc41782826-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-kf4pz\" (UID: \"a0665b62-bc6b-499c-82bd-72fc41782826\") " pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:45.421777 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.421757    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0665b62-bc6b-499c-82bd-72fc41782826-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-kf4pz\" (UID: \"a0665b62-bc6b-499c-82bd-72fc41782826\") " pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:45.432461 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.432432    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh8ld\" (UniqueName: \"kubernetes.io/projected/a0665b62-bc6b-499c-82bd-72fc41782826-kube-api-access-bh8ld\") pod \"payload-processing-5cc6cd444b-kf4pz\" (UID: \"a0665b62-bc6b-499c-82bd-72fc41782826\") " pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:45.502709 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.502683    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:45.543777 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.543747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:45.643285 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.643177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7" event={"ID":"96bcd295-4cb8-4415-b149-75f41b834f1b","Type":"ContainerStarted","Data":"91fd2e1694bdad1ab11df5cedc5578311d40acbb6eaf648a472660cfd35b45e7"}
Jul 27 21:11:45.682238 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.682188    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"]
Jul 27 21:11:45.683331 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:11:45.683300    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6e2f50_66b2_47ba_8e2b_313f8119dbf8.slice/crio-477a55b1000babe1934333edc349b5dd2d86d6d18fef002d5b3f2c6a071e67f6 WatchSource:0}: Error finding container 477a55b1000babe1934333edc349b5dd2d86d6d18fef002d5b3f2c6a071e67f6: Status 404 returned error can't find the container with id 477a55b1000babe1934333edc349b5dd2d86d6d18fef002d5b3f2c6a071e67f6
Jul 27 21:11:45.726827 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:45.726800    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-kf4pz"]
Jul 27 21:11:45.728789 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:11:45.728758    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0665b62_bc6b_499c_82bd_72fc41782826.slice/crio-2e2a8476b142f8fb719c8144b7b5cbb5df717f8feccd30d683e4a1af33720a77 WatchSource:0}: Error finding container 2e2a8476b142f8fb719c8144b7b5cbb5df717f8feccd30d683e4a1af33720a77: Status 404 returned error can't find the container with id 2e2a8476b142f8fb719c8144b7b5cbb5df717f8feccd30d683e4a1af33720a77
Jul 27 21:11:46.662337 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:46.662296    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz" event={"ID":"a0665b62-bc6b-499c-82bd-72fc41782826","Type":"ContainerStarted","Data":"2e2a8476b142f8fb719c8144b7b5cbb5df717f8feccd30d683e4a1af33720a77"}
Jul 27 21:11:46.664499 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:46.664468    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn" event={"ID":"ea6e2f50-66b2-47ba-8e2b-313f8119dbf8","Type":"ContainerStarted","Data":"477a55b1000babe1934333edc349b5dd2d86d6d18fef002d5b3f2c6a071e67f6"}
Jul 27 21:11:47.677112 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:47.676740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7" event={"ID":"96bcd295-4cb8-4415-b149-75f41b834f1b","Type":"ContainerStarted","Data":"c992f29e02c14dd8ca97751bdefdae846ab5adf1a798d571f60905bbfb685616"}
Jul 27 21:11:47.677112 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:47.676846    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:47.711987 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:47.711920    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7" podStartSLOduration=1.434754667 podStartE2EDuration="3.711897223s" totalImagesPullingTime="2.277142556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:47.710100697 +0000 UTC m=+851.975814818" watchObservedRunningTime="2026-07-27 21:11:47.711897223 +0000 UTC m=+851.977611342"
Jul 27 21:11:48.684688 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:48.684595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn" event={"ID":"ea6e2f50-66b2-47ba-8e2b-313f8119dbf8","Type":"ContainerStarted","Data":"f413149cc8568e0ff0f07c49fe8851e8fd309b7914768b875c866a72c9c691e4"}
Jul 27 21:11:48.685096 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:48.684689    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:11:48.686367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:48.686342    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz" event={"ID":"a0665b62-bc6b-499c-82bd-72fc41782826","Type":"ContainerStarted","Data":"79b95418b65a9357185eab1a322961d7eeda8688b58a0f8f771d61989202ed8b"}
Jul 27 21:11:48.686519 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:48.686480    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:11:48.701239 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:48.701165    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn" podStartSLOduration=1.062424507 podStartE2EDuration="3.70115051s" totalImagesPullingTime="2.638726003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:48.698974539 +0000 UTC m=+852.964688658" watchObservedRunningTime="2026-07-27 21:11:48.70115051 +0000 UTC m=+852.966864630"
Jul 27 21:11:48.714731 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:48.714673    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz" podStartSLOduration=1.1275855049999999 podStartE2EDuration="3.714655397s" totalImagesPullingTime="2.587069892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:11:48.7145043 +0000 UTC m=+852.980218421" watchObservedRunningTime="2026-07-27 21:11:48.714655397 +0000 UTC m=+852.980369516"
Jul 27 21:11:53.692048 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:53.692015    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-847d547f49-2mkd7"
Jul 27 21:11:53.715074 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:53.715047    2575 generic.go:356] "Generic (PLEG): container finished" podID="b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2" containerID="11e38189712de1ca398d32352689a9745863e0c0f23020ff9da5b9f3bf7134c1" exitCode=0
Jul 27 21:11:53.715259 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:53.715127    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" event={"ID":"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2","Type":"ContainerDied","Data":"11e38189712de1ca398d32352689a9745863e0c0f23020ff9da5b9f3bf7134c1"}
Jul 27 21:11:53.715535 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:53.715521    2575 scope.go:117] "RemoveContainer" containerID="11e38189712de1ca398d32352689a9745863e0c0f23020ff9da5b9f3bf7134c1"
Jul 27 21:11:53.716573 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:53.716549    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:11:53.716637 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:53.716622    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:11:53.716690 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:53.716663    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:11:54.722296 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:54.722262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" event={"ID":"b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2","Type":"ContainerStarted","Data":"8c7774a01058241a5fe6b227c44adb4e99a37605e26a22b8be84a4e969991d03"}
Jul 27 21:11:55.651370 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:55.651333    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:11:55.652763 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:55.652733    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-phcfn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 27 21:11:55.653055 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:55.653000    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" podUID="b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 27 21:11:56.651380 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:56.651340    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-phcfn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 27 21:11:56.652001 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:56.651965    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" podUID="b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 27 21:11:57.169422 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:57.169380    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:11:57.650726 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:57.650679    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-phcfn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 27 21:11:57.650939 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:57.650750    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" podUID="b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 27 21:11:58.650989 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:58.650942    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-phcfn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 27 21:11:58.651487 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:58.651050    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn" podUID="b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 27 21:11:59.654556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:59.654521    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:11:59.655752 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:59.655730    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phcfn"
Jul 27 21:11:59.693828 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:59.693781    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn" podUID="ea6e2f50-66b2-47ba-8e2b-313f8119dbf8" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.49:9004: connect: connection refused"
Jul 27 21:11:59.694458 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:11:59.694198    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-kf4pz"
Jul 27 21:12:09.693359 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:09.693330    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zt2gn"
Jul 27 21:12:37.180012 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.179931    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"]
Jul 27 21:12:37.182483 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.182466    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.184736 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.184716    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 21:12:37.185754 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.185728    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b6v8k\""
Jul 27 21:12:37.185879 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.185735    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 21:12:37.185879 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.185784    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 21:12:37.192068 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.192039    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"]
Jul 27 21:12:37.340398 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.340347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138a1be2-d6eb-4466-a61a-ab3144668205-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.340574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.340446    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.340574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.340494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t96rd\" (UniqueName: \"kubernetes.io/projected/138a1be2-d6eb-4466-a61a-ab3144668205-kube-api-access-t96rd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.340574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.340528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.340683 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.340574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.340683 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.340610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441335 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441335 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96rd\" (UniqueName: \"kubernetes.io/projected/138a1be2-d6eb-4466-a61a-ab3144668205-kube-api-access-t96rd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441335 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441335 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441661 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441661 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138a1be2-d6eb-4466-a61a-ab3144668205-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441764 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441740    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441807 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.441870 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.441805    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.443585 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.443560    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138a1be2-d6eb-4466-a61a-ab3144668205-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.443933 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.443914    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138a1be2-d6eb-4466-a61a-ab3144668205-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.448895 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.448874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96rd\" (UniqueName: \"kubernetes.io/projected/138a1be2-d6eb-4466-a61a-ab3144668205-kube-api-access-t96rd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9qwct\" (UID: \"138a1be2-d6eb-4466-a61a-ab3144668205\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.495991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.495949    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:37.635094 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.635063    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"]
Jul 27 21:12:37.637461 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:12:37.637424    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138a1be2_d6eb_4466_a61a_ab3144668205.slice/crio-adb17f755b189d52f6901d384714053503a44fdbbe6be3195b3a5a1c15795f54 WatchSource:0}: Error finding container adb17f755b189d52f6901d384714053503a44fdbbe6be3195b3a5a1c15795f54: Status 404 returned error can't find the container with id adb17f755b189d52f6901d384714053503a44fdbbe6be3195b3a5a1c15795f54
Jul 27 21:12:37.941828 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:37.941794    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct" event={"ID":"138a1be2-d6eb-4466-a61a-ab3144668205","Type":"ContainerStarted","Data":"adb17f755b189d52f6901d384714053503a44fdbbe6be3195b3a5a1c15795f54"}
Jul 27 21:12:38.948822 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:38.948776    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct" event={"ID":"138a1be2-d6eb-4466-a61a-ab3144668205","Type":"ContainerStarted","Data":"6b0b8124e9b9280b2ced931179567ef44d74b09888b050a737d8bab292a2bca2"}
Jul 27 21:12:38.967075 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:38.966959    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct" podStartSLOduration=0.888105639 podStartE2EDuration="1.966935674s" totalImagesPullingTime="1.078830035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:12:38.964750616 +0000 UTC m=+903.230464754" watchObservedRunningTime="2026-07-27 21:12:38.966935674 +0000 UTC m=+903.232649794"
Jul 27 21:12:47.496690 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:47.496635    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:47.497189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:47.496726    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:47.509182 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:47.509149    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:12:48.006782 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:12:48.006749    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9qwct"
Jul 27 21:13:20.575771 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.575731    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"]
Jul 27 21:13:20.579581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.579561    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.582134 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.582113    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 21:13:20.585745 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.585721    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"]
Jul 27 21:13:20.662451 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.662417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3365a9f-7181-4505-bb3c-9387e7b083d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.662451 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.662450    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.662677 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.662469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjksj\" (UniqueName: \"kubernetes.io/projected/e3365a9f-7181-4505-bb3c-9387e7b083d6-kube-api-access-cjksj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.662677 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.662510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.662677 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.662599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.662677 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.662625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763244 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763244 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763498 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3365a9f-7181-4505-bb3c-9387e7b083d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763498 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763498 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjksj\" (UniqueName: \"kubernetes.io/projected/e3365a9f-7181-4505-bb3c-9387e7b083d6-kube-api-access-cjksj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763498 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763737 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763716    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763804 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.763864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.763839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.765841 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.765812    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3365a9f-7181-4505-bb3c-9387e7b083d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.765981 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.765965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3365a9f-7181-4505-bb3c-9387e7b083d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.772463 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.772439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjksj\" (UniqueName: \"kubernetes.io/projected/e3365a9f-7181-4505-bb3c-9387e7b083d6-kube-api-access-cjksj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-29kpd\" (UID: \"e3365a9f-7181-4505-bb3c-9387e7b083d6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:20.890505 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:20.890408    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:21.026942 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:21.026916    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"]
Jul 27 21:13:21.029060 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:13:21.029022    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3365a9f_7181_4505_bb3c_9387e7b083d6.slice/crio-4a3f654a2f35f190f8682488132e4f4c94b32865bdaea321d7cf583879b6c408 WatchSource:0}: Error finding container 4a3f654a2f35f190f8682488132e4f4c94b32865bdaea321d7cf583879b6c408: Status 404 returned error can't find the container with id 4a3f654a2f35f190f8682488132e4f4c94b32865bdaea321d7cf583879b6c408
Jul 27 21:13:21.158538 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:21.158451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd" event={"ID":"e3365a9f-7181-4505-bb3c-9387e7b083d6","Type":"ContainerStarted","Data":"4a3f654a2f35f190f8682488132e4f4c94b32865bdaea321d7cf583879b6c408"}
Jul 27 21:13:22.165118 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:22.165078    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd" event={"ID":"e3365a9f-7181-4505-bb3c-9387e7b083d6","Type":"ContainerStarted","Data":"9f6eb8f09938821ee7bb63d9e57de3cd4b3dcc254b0b28d6adef5fd354fa5c78"}
Jul 27 21:13:22.183799 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:22.183746    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd" podStartSLOduration=2.005758197 podStartE2EDuration="2.183731605s" totalImagesPullingTime="177.973408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:13:22.181544421 +0000 UTC m=+946.447258538" watchObservedRunningTime="2026-07-27 21:13:22.183731605 +0000 UTC m=+946.449445724"
Jul 27 21:13:30.891494 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:30.891451    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:30.891960 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:30.891532    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:30.904176 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:30.904145    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:13:31.222670 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:13:31.222587    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-29kpd"
Jul 27 21:14:02.768971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.768884    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c88d45cc-x6hkm"]
Jul 27 21:14:02.772410 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.772381    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c88d45cc-x6hkm"
Jul 27 21:14:02.777515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.777489    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c88d45cc-x6hkm"]
Jul 27 21:14:02.846203 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.846158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwlh7\" (UniqueName: \"kubernetes.io/projected/9910b9be-246a-4889-9ea4-cca2932ccc25-kube-api-access-fwlh7\") pod \"authorino-7c88d45cc-x6hkm\" (UID: \"9910b9be-246a-4889-9ea4-cca2932ccc25\") " pod="kuadrant-system/authorino-7c88d45cc-x6hkm"
Jul 27 21:14:02.846464 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.846287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9910b9be-246a-4889-9ea4-cca2932ccc25-tls-cert\") pod \"authorino-7c88d45cc-x6hkm\" (UID: \"9910b9be-246a-4889-9ea4-cca2932ccc25\") " pod="kuadrant-system/authorino-7c88d45cc-x6hkm"
Jul 27 21:14:02.946864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.946826    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9910b9be-246a-4889-9ea4-cca2932ccc25-tls-cert\") pod \"authorino-7c88d45cc-x6hkm\" (UID: \"9910b9be-246a-4889-9ea4-cca2932ccc25\") " pod="kuadrant-system/authorino-7c88d45cc-x6hkm"
Jul 27 21:14:02.947053 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.946915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwlh7\" (UniqueName: \"kubernetes.io/projected/9910b9be-246a-4889-9ea4-cca2932ccc25-kube-api-access-fwlh7\") pod \"authorino-7c88d45cc-x6hkm\" (UID: \"9910b9be-246a-4889-9ea4-cca2932ccc25\") " pod="kuadrant-system/authorino-7c88d45cc-x6hkm"
Jul 27 21:14:02.949715 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.949682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9910b9be-246a-4889-9ea4-cca2932ccc25-tls-cert\") pod \"authorino-7c88d45cc-x6hkm\" (UID: \"9910b9be-246a-4889-9ea4-cca2932ccc25\") " pod="kuadrant-system/authorino-7c88d45cc-x6hkm"
Jul 27 21:14:02.956040 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:02.956016    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwlh7\" (UniqueName: \"kubernetes.io/projected/9910b9be-246a-4889-9ea4-cca2932ccc25-kube-api-access-fwlh7\") pod \"authorino-7c88d45cc-x6hkm\" (UID: \"9910b9be-246a-4889-9ea4-cca2932ccc25\") " pod="kuadrant-system/authorino-7c88d45cc-x6hkm"
Jul 27 21:14:03.083731 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:03.083640    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c88d45cc-x6hkm"
Jul 27 21:14:03.224652 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:03.224626    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c88d45cc-x6hkm"]
Jul 27 21:14:03.226810 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:14:03.226783    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9910b9be_246a_4889_9ea4_cca2932ccc25.slice/crio-f2dd6cbeac9a395d6b2bb0fca32f336faa7d34290a5198093fa0a98c8737c628 WatchSource:0}: Error finding container f2dd6cbeac9a395d6b2bb0fca32f336faa7d34290a5198093fa0a98c8737c628: Status 404 returned error can't find the container with id f2dd6cbeac9a395d6b2bb0fca32f336faa7d34290a5198093fa0a98c8737c628
Jul 27 21:14:03.373302 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:03.373197    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c88d45cc-x6hkm" event={"ID":"9910b9be-246a-4889-9ea4-cca2932ccc25","Type":"ContainerStarted","Data":"f2dd6cbeac9a395d6b2bb0fca32f336faa7d34290a5198093fa0a98c8737c628"}
Jul 27 21:14:04.383754 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.383716    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c88d45cc-x6hkm" event={"ID":"9910b9be-246a-4889-9ea4-cca2932ccc25","Type":"ContainerStarted","Data":"c6a4291c2b9dbc74c6a228641d44b5ecfb555b2671e15535e3b01c09bdf26a67"}
Jul 27 21:14:04.432613 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.432544    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c88d45cc-x6hkm" podStartSLOduration=1.943979373 podStartE2EDuration="2.43250275s" totalImagesPullingTime="488.523377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:14:04.403536621 +0000 UTC m=+988.669250740" watchObservedRunningTime="2026-07-27 21:14:04.43250275 +0000 UTC m=+988.698216870"
Jul 27 21:14:04.434069 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.434041    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5db67656d8-jch24"]
Jul 27 21:14:04.434485 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.434453    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5db67656d8-jch24" podUID="a852e322-895f-4fc6-9287-f259e53cc9a3" containerName="authorino" containerID="cri-o://823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27" gracePeriod=30
Jul 27 21:14:04.708549 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.708524    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:14:04.870933 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.870889    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a852e322-895f-4fc6-9287-f259e53cc9a3-tls-cert\") pod \"a852e322-895f-4fc6-9287-f259e53cc9a3\" (UID: \"a852e322-895f-4fc6-9287-f259e53cc9a3\") "
Jul 27 21:14:04.871114 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.870992    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lj2v\" (UniqueName: \"kubernetes.io/projected/a852e322-895f-4fc6-9287-f259e53cc9a3-kube-api-access-8lj2v\") pod \"a852e322-895f-4fc6-9287-f259e53cc9a3\" (UID: \"a852e322-895f-4fc6-9287-f259e53cc9a3\") "
Jul 27 21:14:04.873127 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.873094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a852e322-895f-4fc6-9287-f259e53cc9a3-kube-api-access-8lj2v" (OuterVolumeSpecName: "kube-api-access-8lj2v") pod "a852e322-895f-4fc6-9287-f259e53cc9a3" (UID: "a852e322-895f-4fc6-9287-f259e53cc9a3"). InnerVolumeSpecName "kube-api-access-8lj2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:14:04.882546 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.882519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a852e322-895f-4fc6-9287-f259e53cc9a3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a852e322-895f-4fc6-9287-f259e53cc9a3" (UID: "a852e322-895f-4fc6-9287-f259e53cc9a3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:14:04.972419 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.972377    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lj2v\" (UniqueName: \"kubernetes.io/projected/a852e322-895f-4fc6-9287-f259e53cc9a3-kube-api-access-8lj2v\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:14:04.972419 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:04.972411    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a852e322-895f-4fc6-9287-f259e53cc9a3-tls-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:14:05.391644 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.391606    2575 generic.go:356] "Generic (PLEG): container finished" podID="a852e322-895f-4fc6-9287-f259e53cc9a3" containerID="823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27" exitCode=0
Jul 27 21:14:05.392125 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.391664    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5db67656d8-jch24"
Jul 27 21:14:05.392125 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.391697    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db67656d8-jch24" event={"ID":"a852e322-895f-4fc6-9287-f259e53cc9a3","Type":"ContainerDied","Data":"823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27"}
Jul 27 21:14:05.392125 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.391740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5db67656d8-jch24" event={"ID":"a852e322-895f-4fc6-9287-f259e53cc9a3","Type":"ContainerDied","Data":"f7d92823a6bc3068a1df16e7fc88233b292c20084cba6861f7d66d5b33c4b9fe"}
Jul 27 21:14:05.392125 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.391757    2575 scope.go:117] "RemoveContainer" containerID="823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27"
Jul 27 21:14:05.401584 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.401565    2575 scope.go:117] "RemoveContainer" containerID="823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27"
Jul 27 21:14:05.401911 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:14:05.401887    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27\": container with ID starting with 823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27 not found: ID does not exist" containerID="823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27"
Jul 27 21:14:05.402022 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.401921    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27"} err="failed to get container status \"823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27\": rpc error: code = NotFound desc = could not find container \"823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27\": container with ID starting with 823133be17d6d4d4aa90fb0c725f78b5132c678fe65397889c34aa11c0326a27 not found: ID does not exist"
Jul 27 21:14:05.414341 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.414310    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5db67656d8-jch24"]
Jul 27 21:14:05.418368 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:05.418344    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5db67656d8-jch24"]
Jul 27 21:14:06.278549 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:06.278516    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a852e322-895f-4fc6-9287-f259e53cc9a3" path="/var/lib/kubelet/pods/a852e322-895f-4fc6-9287-f259e53cc9a3/volumes"
Jul 27 21:14:53.169307 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.169270    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6574497c9c-rzt2f"]
Jul 27 21:14:53.169764 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.169498    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6574497c9c-rzt2f" podUID="76cba085-ac03-4fbe-8962-3cd6b6c5819a" containerName="manager" containerID="cri-o://8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365" gracePeriod=30
Jul 27 21:14:53.420920 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.420858    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:14:53.509804 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.509775    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt45p\" (UniqueName: \"kubernetes.io/projected/76cba085-ac03-4fbe-8962-3cd6b6c5819a-kube-api-access-zt45p\") pod \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") "
Jul 27 21:14:53.509981 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.509857    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert\") pod \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\" (UID: \"76cba085-ac03-4fbe-8962-3cd6b6c5819a\") "
Jul 27 21:14:53.511992 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.511965    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "76cba085-ac03-4fbe-8962-3cd6b6c5819a" (UID: "76cba085-ac03-4fbe-8962-3cd6b6c5819a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:14:53.512112 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.512059    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76cba085-ac03-4fbe-8962-3cd6b6c5819a-kube-api-access-zt45p" (OuterVolumeSpecName: "kube-api-access-zt45p") pod "76cba085-ac03-4fbe-8962-3cd6b6c5819a" (UID: "76cba085-ac03-4fbe-8962-3cd6b6c5819a"). InnerVolumeSpecName "kube-api-access-zt45p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:14:53.610504 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.610473    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt45p\" (UniqueName: \"kubernetes.io/projected/76cba085-ac03-4fbe-8962-3cd6b6c5819a-kube-api-access-zt45p\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:14:53.610504 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.610500    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76cba085-ac03-4fbe-8962-3cd6b6c5819a-webhook-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:14:53.647907 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.647872    2575 generic.go:356] "Generic (PLEG): container finished" podID="76cba085-ac03-4fbe-8962-3cd6b6c5819a" containerID="8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365" exitCode=0
Jul 27 21:14:53.648105 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.647925    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-rzt2f"
Jul 27 21:14:53.648105 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.647971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-rzt2f" event={"ID":"76cba085-ac03-4fbe-8962-3cd6b6c5819a","Type":"ContainerDied","Data":"8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365"}
Jul 27 21:14:53.648105 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.648037    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-rzt2f" event={"ID":"76cba085-ac03-4fbe-8962-3cd6b6c5819a","Type":"ContainerDied","Data":"716046154dae680dd0fe26dedf925ad35862f3df557d537c8c0a3d9ae20bf118"}
Jul 27 21:14:53.648105 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.648066    2575 scope.go:117] "RemoveContainer" containerID="8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365"
Jul 27 21:14:53.657956 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.657938    2575 scope.go:117] "RemoveContainer" containerID="8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365"
Jul 27 21:14:53.658267 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:14:53.658244    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365\": container with ID starting with 8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365 not found: ID does not exist" containerID="8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365"
Jul 27 21:14:53.658343 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.658275    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365"} err="failed to get container status \"8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365\": rpc error: code = NotFound desc = could not find container \"8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365\": container with ID starting with 8e7ebb7dffda8e23f2f9f660d229a105115ff59be885ad17f84d6702df2f3365 not found: ID does not exist"
Jul 27 21:14:53.674571 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.674500    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6574497c9c-rzt2f"]
Jul 27 21:14:53.674758 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:53.674733    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6574497c9c-rzt2f"]
Jul 27 21:14:54.278504 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:14:54.278470    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76cba085-ac03-4fbe-8962-3cd6b6c5819a" path="/var/lib/kubelet/pods/76cba085-ac03-4fbe-8962-3cd6b6c5819a/volumes"
Jul 27 21:15:54.555187 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.555150    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6574497c9c-d4n5n"]
Jul 27 21:15:54.555671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.555561    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a852e322-895f-4fc6-9287-f259e53cc9a3" containerName="authorino"
Jul 27 21:15:54.555671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.555572    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a852e322-895f-4fc6-9287-f259e53cc9a3" containerName="authorino"
Jul 27 21:15:54.555671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.555585    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76cba085-ac03-4fbe-8962-3cd6b6c5819a" containerName="manager"
Jul 27 21:15:54.555671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.555590    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="76cba085-ac03-4fbe-8962-3cd6b6c5819a" containerName="manager"
Jul 27 21:15:54.555671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.555652    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="76cba085-ac03-4fbe-8962-3cd6b6c5819a" containerName="manager"
Jul 27 21:15:54.555671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.555662    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a852e322-895f-4fc6-9287-f259e53cc9a3" containerName="authorino"
Jul 27 21:15:54.559943 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.559923    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:54.562295 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.562274    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 21:15:54.563305 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.563284    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nlmph\""
Jul 27 21:15:54.563408 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.563308    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 21:15:54.568983 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.568957    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6574497c9c-d4n5n"]
Jul 27 21:15:54.673186 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.673148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5ksq\" (UniqueName: \"kubernetes.io/projected/45a5b092-ebb8-4361-a7f8-29f7a196d34e-kube-api-access-p5ksq\") pod \"maas-controller-6574497c9c-d4n5n\" (UID: \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\") " pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:54.673186 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.673187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45a5b092-ebb8-4361-a7f8-29f7a196d34e-webhook-cert\") pod \"maas-controller-6574497c9c-d4n5n\" (UID: \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\") " pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:54.773843 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.773808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5ksq\" (UniqueName: \"kubernetes.io/projected/45a5b092-ebb8-4361-a7f8-29f7a196d34e-kube-api-access-p5ksq\") pod \"maas-controller-6574497c9c-d4n5n\" (UID: \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\") " pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:54.773843 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.773846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45a5b092-ebb8-4361-a7f8-29f7a196d34e-webhook-cert\") pod \"maas-controller-6574497c9c-d4n5n\" (UID: \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\") " pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:54.776580 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.776557    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45a5b092-ebb8-4361-a7f8-29f7a196d34e-webhook-cert\") pod \"maas-controller-6574497c9c-d4n5n\" (UID: \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\") " pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:54.783159 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.783135    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5ksq\" (UniqueName: \"kubernetes.io/projected/45a5b092-ebb8-4361-a7f8-29f7a196d34e-kube-api-access-p5ksq\") pod \"maas-controller-6574497c9c-d4n5n\" (UID: \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\") " pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:54.871673 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:54.871581    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:55.012894 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:55.012871    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6574497c9c-d4n5n"]
Jul 27 21:15:55.015005 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:15:55.014985    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a5b092_ebb8_4361_a7f8_29f7a196d34e.slice/crio-e1125a7b4cec3857dae0a2ad0c7af09759ff6e8670b766fda170a1796e8ae84a WatchSource:0}: Error finding container e1125a7b4cec3857dae0a2ad0c7af09759ff6e8670b766fda170a1796e8ae84a: Status 404 returned error can't find the container with id e1125a7b4cec3857dae0a2ad0c7af09759ff6e8670b766fda170a1796e8ae84a
Jul 27 21:15:55.016908 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:55.016886    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:15:55.971702 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:55.971595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-d4n5n" event={"ID":"45a5b092-ebb8-4361-a7f8-29f7a196d34e","Type":"ContainerStarted","Data":"78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa"}
Jul 27 21:15:55.971702 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:55.971660    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-d4n5n" event={"ID":"45a5b092-ebb8-4361-a7f8-29f7a196d34e","Type":"ContainerStarted","Data":"e1125a7b4cec3857dae0a2ad0c7af09759ff6e8670b766fda170a1796e8ae84a"}
Jul 27 21:15:55.971702 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:55.971691    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:15:55.991019 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:15:55.990964    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6574497c9c-d4n5n" podStartSLOduration=1.381035054 podStartE2EDuration="1.990948094s" totalImagesPullingTime="609.91304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:15:55.99018912 +0000 UTC m=+1100.255903240" watchObservedRunningTime="2026-07-27 21:15:55.990948094 +0000 UTC m=+1100.256662212"
Jul 27 21:16:06.979291 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:06.979262    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:16:11.653091 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:11.653051    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6574497c9c-d4n5n"]
Jul 27 21:16:11.653617 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:11.653279    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6574497c9c-d4n5n" podUID="45a5b092-ebb8-4361-a7f8-29f7a196d34e" containerName="manager" containerID="cri-o://78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa" gracePeriod=30
Jul 27 21:16:11.906864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:11.906801    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:16:12.031797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.031762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45a5b092-ebb8-4361-a7f8-29f7a196d34e-webhook-cert\") pod \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\" (UID: \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\") "
Jul 27 21:16:12.031995 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.031854    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5ksq\" (UniqueName: \"kubernetes.io/projected/45a5b092-ebb8-4361-a7f8-29f7a196d34e-kube-api-access-p5ksq\") pod \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\" (UID: \"45a5b092-ebb8-4361-a7f8-29f7a196d34e\") "
Jul 27 21:16:12.034264 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.034230    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45a5b092-ebb8-4361-a7f8-29f7a196d34e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "45a5b092-ebb8-4361-a7f8-29f7a196d34e" (UID: "45a5b092-ebb8-4361-a7f8-29f7a196d34e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:16:12.034359 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.034271    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a5b092-ebb8-4361-a7f8-29f7a196d34e-kube-api-access-p5ksq" (OuterVolumeSpecName: "kube-api-access-p5ksq") pod "45a5b092-ebb8-4361-a7f8-29f7a196d34e" (UID: "45a5b092-ebb8-4361-a7f8-29f7a196d34e"). InnerVolumeSpecName "kube-api-access-p5ksq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:16:12.057955 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.057929    2575 generic.go:356] "Generic (PLEG): container finished" podID="45a5b092-ebb8-4361-a7f8-29f7a196d34e" containerID="78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa" exitCode=0
Jul 27 21:16:12.058104 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.057972    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-d4n5n"
Jul 27 21:16:12.058104 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.058020    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-d4n5n" event={"ID":"45a5b092-ebb8-4361-a7f8-29f7a196d34e","Type":"ContainerDied","Data":"78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa"}
Jul 27 21:16:12.058104 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.058080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-d4n5n" event={"ID":"45a5b092-ebb8-4361-a7f8-29f7a196d34e","Type":"ContainerDied","Data":"e1125a7b4cec3857dae0a2ad0c7af09759ff6e8670b766fda170a1796e8ae84a"}
Jul 27 21:16:12.058292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.058110    2575 scope.go:117] "RemoveContainer" containerID="78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa"
Jul 27 21:16:12.067509 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.067491    2575 scope.go:117] "RemoveContainer" containerID="78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa"
Jul 27 21:16:12.067768 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:16:12.067749    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa\": container with ID starting with 78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa not found: ID does not exist" containerID="78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa"
Jul 27 21:16:12.067813 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.067780    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa"} err="failed to get container status \"78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa\": rpc error: code = NotFound desc = could not find container \"78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa\": container with ID starting with 78a66c6f07bd045e7a11964b49e677a8429adf32bc099119c79988ffef412dfa not found: ID does not exist"
Jul 27 21:16:12.079396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.079372    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6574497c9c-d4n5n"]
Jul 27 21:16:12.083252 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.083233    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6574497c9c-d4n5n"]
Jul 27 21:16:12.132769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.132740    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45a5b092-ebb8-4361-a7f8-29f7a196d34e-webhook-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:16:12.132769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.132764    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5ksq\" (UniqueName: \"kubernetes.io/projected/45a5b092-ebb8-4361-a7f8-29f7a196d34e-kube-api-access-p5ksq\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:16:12.278456 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.278418    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45a5b092-ebb8-4361-a7f8-29f7a196d34e" path="/var/lib/kubelet/pods/45a5b092-ebb8-4361-a7f8-29f7a196d34e/volumes"
Jul 27 21:16:12.878628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.878588    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6574497c9c-k8njw"]
Jul 27 21:16:12.879114 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.879008    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a5b092-ebb8-4361-a7f8-29f7a196d34e" containerName="manager"
Jul 27 21:16:12.879114 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.879020    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a5b092-ebb8-4361-a7f8-29f7a196d34e" containerName="manager"
Jul 27 21:16:12.879114 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.879077    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a5b092-ebb8-4361-a7f8-29f7a196d34e" containerName="manager"
Jul 27 21:16:12.883023 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.883007    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:12.886803 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.886672    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 21:16:12.886803 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.886684    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nlmph\""
Jul 27 21:16:12.886803 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.886764    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 21:16:12.893031 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:12.893005    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6574497c9c-k8njw"]
Jul 27 21:16:13.039168 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:13.039132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/434d0e3d-746f-4bab-b492-014c02bc7ce4-webhook-cert\") pod \"maas-controller-6574497c9c-k8njw\" (UID: \"434d0e3d-746f-4bab-b492-014c02bc7ce4\") " pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:13.039392 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:13.039196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-www6g\" (UniqueName: \"kubernetes.io/projected/434d0e3d-746f-4bab-b492-014c02bc7ce4-kube-api-access-www6g\") pod \"maas-controller-6574497c9c-k8njw\" (UID: \"434d0e3d-746f-4bab-b492-014c02bc7ce4\") " pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:13.140396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:13.140293    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/434d0e3d-746f-4bab-b492-014c02bc7ce4-webhook-cert\") pod \"maas-controller-6574497c9c-k8njw\" (UID: \"434d0e3d-746f-4bab-b492-014c02bc7ce4\") " pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:13.140396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:13.140373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-www6g\" (UniqueName: \"kubernetes.io/projected/434d0e3d-746f-4bab-b492-014c02bc7ce4-kube-api-access-www6g\") pod \"maas-controller-6574497c9c-k8njw\" (UID: \"434d0e3d-746f-4bab-b492-014c02bc7ce4\") " pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:13.142898 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:13.142864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/434d0e3d-746f-4bab-b492-014c02bc7ce4-webhook-cert\") pod \"maas-controller-6574497c9c-k8njw\" (UID: \"434d0e3d-746f-4bab-b492-014c02bc7ce4\") " pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:13.148639 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:13.148619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-www6g\" (UniqueName: \"kubernetes.io/projected/434d0e3d-746f-4bab-b492-014c02bc7ce4-kube-api-access-www6g\") pod \"maas-controller-6574497c9c-k8njw\" (UID: \"434d0e3d-746f-4bab-b492-014c02bc7ce4\") " pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:13.194633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:13.194595    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:13.332510 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:13.332483    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6574497c9c-k8njw"]
Jul 27 21:16:13.334117 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:16:13.334083    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434d0e3d_746f_4bab_b492_014c02bc7ce4.slice/crio-66419367b7d614c0e4145b632782b23743aed2d29c6dbad352bf864f9ac1e30b WatchSource:0}: Error finding container 66419367b7d614c0e4145b632782b23743aed2d29c6dbad352bf864f9ac1e30b: Status 404 returned error can't find the container with id 66419367b7d614c0e4145b632782b23743aed2d29c6dbad352bf864f9ac1e30b
Jul 27 21:16:14.071070 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:14.070957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-k8njw" event={"ID":"434d0e3d-746f-4bab-b492-014c02bc7ce4","Type":"ContainerStarted","Data":"e2cbb585a95d08a8867c6c00703ad95b12822778ff5f99322ad9a1b0731bfe7b"}
Jul 27 21:16:14.071511 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:14.071080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6574497c9c-k8njw" event={"ID":"434d0e3d-746f-4bab-b492-014c02bc7ce4","Type":"ContainerStarted","Data":"66419367b7d614c0e4145b632782b23743aed2d29c6dbad352bf864f9ac1e30b"}
Jul 27 21:16:14.071511 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:14.071111    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:16:14.089774 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:14.089717    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6574497c9c-k8njw" podStartSLOduration=1.666397292 podStartE2EDuration="2.08970164s" totalImagesPullingTime="423.304348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:16:14.08752752 +0000 UTC m=+1118.353241640" watchObservedRunningTime="2026-07-27 21:16:14.08970164 +0000 UTC m=+1118.355415779"
Jul 27 21:16:25.078395 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:16:25.078361    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6574497c9c-k8njw"
Jul 27 21:24:56.829347 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.829268    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"]
Jul 27 21:24:56.832769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.832753    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.840569 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.840551    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-4fc98703-kserve-self-signed-certs\""
Jul 27 21:24:56.890498 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.890466    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"]
Jul 27 21:24:56.892700 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.892675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-home\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.892851 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.892722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-dshm\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.892851 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.892813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-tmp-dir\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.892972 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.892867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thlt6\" (UniqueName: \"kubernetes.io/projected/960db99f-0a79-423e-896a-e6c53b16cb29-kube-api-access-thlt6\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.892972 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.892904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-model-cache\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.892972 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.892929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960db99f-0a79-423e-896a-e6c53b16cb29-tls-certs\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994054 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-home\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994264 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-dshm\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994264 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-tmp-dir\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994264 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thlt6\" (UniqueName: \"kubernetes.io/projected/960db99f-0a79-423e-896a-e6c53b16cb29-kube-api-access-thlt6\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994264 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-model-cache\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994264 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960db99f-0a79-423e-896a-e6c53b16cb29-tls-certs\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994550 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994508    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-home\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994550 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994532    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-model-cache\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.994661 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.994584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-tmp-dir\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.996569 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.996551    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-dshm\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:56.996831 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:56.996814    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960db99f-0a79-423e-896a-e6c53b16cb29-tls-certs\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:57.003832 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:57.003809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thlt6\" (UniqueName: \"kubernetes.io/projected/960db99f-0a79-423e-896a-e6c53b16cb29-kube-api-access-thlt6\") pod \"e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") " pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:57.142238 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:57.142137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:24:57.287475 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:57.287442    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"]
Jul 27 21:24:57.291695 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:24:57.291666    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod960db99f_0a79_423e_896a_e6c53b16cb29.slice/crio-51069c71e3e4854996f3d8d8cd2a043d61b033142479e7427a5e67324adb04e8 WatchSource:0}: Error finding container 51069c71e3e4854996f3d8d8cd2a043d61b033142479e7427a5e67324adb04e8: Status 404 returned error can't find the container with id 51069c71e3e4854996f3d8d8cd2a043d61b033142479e7427a5e67324adb04e8
Jul 27 21:24:57.763283 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:57.763242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n" event={"ID":"960db99f-0a79-423e-896a-e6c53b16cb29","Type":"ContainerStarted","Data":"0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205"}
Jul 27 21:24:57.763457 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:57.763293    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n" event={"ID":"960db99f-0a79-423e-896a-e6c53b16cb29","Type":"ContainerStarted","Data":"51069c71e3e4854996f3d8d8cd2a043d61b033142479e7427a5e67324adb04e8"}
Jul 27 21:24:57.784443 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:24:57.784389    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n" podStartSLOduration=1.784374858 podStartE2EDuration="1.784374858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:24:57.78351831 +0000 UTC m=+1642.049232428" watchObservedRunningTime="2026-07-27 21:24:57.784374858 +0000 UTC m=+1642.050089010"
Jul 27 21:25:07.142402 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:07.142310    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:25:07.142402 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:07.142365    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:25:07.155820 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:07.155791    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:25:07.826553 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:07.826516    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:25:35.219721 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:35.219689    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"]
Jul 27 21:25:50.240023 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.239956    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n" podUID="960db99f-0a79-423e-896a-e6c53b16cb29" containerName="main" containerID="cri-o://0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205" gracePeriod=45
Jul 27 21:25:50.489651 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.489628    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:25:50.678373 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678272    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thlt6\" (UniqueName: \"kubernetes.io/projected/960db99f-0a79-423e-896a-e6c53b16cb29-kube-api-access-thlt6\") pod \"960db99f-0a79-423e-896a-e6c53b16cb29\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") "
Jul 27 21:25:50.678373 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678336    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-home\") pod \"960db99f-0a79-423e-896a-e6c53b16cb29\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") "
Jul 27 21:25:50.678606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678452    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-model-cache\") pod \"960db99f-0a79-423e-896a-e6c53b16cb29\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") "
Jul 27 21:25:50.678606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678510    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960db99f-0a79-423e-896a-e6c53b16cb29-tls-certs\") pod \"960db99f-0a79-423e-896a-e6c53b16cb29\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") "
Jul 27 21:25:50.678606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678533    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-tmp-dir\") pod \"960db99f-0a79-423e-896a-e6c53b16cb29\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") "
Jul 27 21:25:50.678606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678553    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-dshm\") pod \"960db99f-0a79-423e-896a-e6c53b16cb29\" (UID: \"960db99f-0a79-423e-896a-e6c53b16cb29\") "
Jul 27 21:25:50.678606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678583    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-home" (OuterVolumeSpecName: "home") pod "960db99f-0a79-423e-896a-e6c53b16cb29" (UID: "960db99f-0a79-423e-896a-e6c53b16cb29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:25:50.678820 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678675    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-model-cache" (OuterVolumeSpecName: "model-cache") pod "960db99f-0a79-423e-896a-e6c53b16cb29" (UID: "960db99f-0a79-423e-896a-e6c53b16cb29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:25:50.678864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678811    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "960db99f-0a79-423e-896a-e6c53b16cb29" (UID: "960db99f-0a79-423e-896a-e6c53b16cb29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:25:50.678943 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678926    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-home\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:25:50.678980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678949    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-model-cache\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:25:50.678980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.678966    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-tmp-dir\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:25:50.680770 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.680736    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-dshm" (OuterVolumeSpecName: "dshm") pod "960db99f-0a79-423e-896a-e6c53b16cb29" (UID: "960db99f-0a79-423e-896a-e6c53b16cb29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:25:50.680882 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.680778    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960db99f-0a79-423e-896a-e6c53b16cb29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "960db99f-0a79-423e-896a-e6c53b16cb29" (UID: "960db99f-0a79-423e-896a-e6c53b16cb29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:25:50.680882 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.680797    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960db99f-0a79-423e-896a-e6c53b16cb29-kube-api-access-thlt6" (OuterVolumeSpecName: "kube-api-access-thlt6") pod "960db99f-0a79-423e-896a-e6c53b16cb29" (UID: "960db99f-0a79-423e-896a-e6c53b16cb29"). InnerVolumeSpecName "kube-api-access-thlt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:25:50.780456 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.780423    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thlt6\" (UniqueName: \"kubernetes.io/projected/960db99f-0a79-423e-896a-e6c53b16cb29-kube-api-access-thlt6\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:25:50.780456 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.780452    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/960db99f-0a79-423e-896a-e6c53b16cb29-tls-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:25:50.780456 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:50.780461    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/960db99f-0a79-423e-896a-e6c53b16cb29-dshm\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:25:51.032654 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.032614    2575 generic.go:356] "Generic (PLEG): container finished" podID="960db99f-0a79-423e-896a-e6c53b16cb29" containerID="0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205" exitCode=0
Jul 27 21:25:51.032817 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.032662    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"
Jul 27 21:25:51.032817 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.032688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n" event={"ID":"960db99f-0a79-423e-896a-e6c53b16cb29","Type":"ContainerDied","Data":"0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205"}
Jul 27 21:25:51.032817 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.032726    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n" event={"ID":"960db99f-0a79-423e-896a-e6c53b16cb29","Type":"ContainerDied","Data":"51069c71e3e4854996f3d8d8cd2a043d61b033142479e7427a5e67324adb04e8"}
Jul 27 21:25:51.032817 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.032749    2575 scope.go:117] "RemoveContainer" containerID="0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205"
Jul 27 21:25:51.042447 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.042428    2575 scope.go:117] "RemoveContainer" containerID="0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205"
Jul 27 21:25:51.042707 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:25:51.042688    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205\": container with ID starting with 0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205 not found: ID does not exist" containerID="0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205"
Jul 27 21:25:51.042750 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.042717    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205"} err="failed to get container status \"0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205\": rpc error: code = NotFound desc = could not find container \"0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205\": container with ID starting with 0c49d0dbf929f955cc6ed3ff9046d48fbc0b37a6a4a148f9be144b7660300205 not found: ID does not exist"
Jul 27 21:25:51.060325 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.060298    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"]
Jul 27 21:25:51.065037 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:51.065018    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-4fc98703-kserve-5d5476b559-4zn2n"]
Jul 27 21:25:52.277600 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:25:52.277566    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960db99f-0a79-423e-896a-e6c53b16cb29" path="/var/lib/kubelet/pods/960db99f-0a79-423e-896a-e6c53b16cb29/volumes"
Jul 27 21:29:15.923313 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.923234    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"]
Jul 27 21:29:15.923779 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.923665    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960db99f-0a79-423e-896a-e6c53b16cb29" containerName="main"
Jul 27 21:29:15.923779 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.923675    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="960db99f-0a79-423e-896a-e6c53b16cb29" containerName="main"
Jul 27 21:29:15.923779 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.923733    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="960db99f-0a79-423e-896a-e6c53b16cb29" containerName="main"
Jul 27 21:29:15.926945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.926928    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.930782 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.930756    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-de98b5e8-openshift-default-dockercfg-kbjzj\""
Jul 27 21:29:15.964470 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.964445    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"]
Jul 27 21:29:15.997167 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-podinfo\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.997317 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-credential-socket\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.997317 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997227    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-certs\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.997317 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-data\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.997426 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0adb2603-1414-49f2-b3e9-90ac40d23960-istiod-ca-cert\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.997426 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-socket\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.997426 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997385    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvqrf\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-kube-api-access-nvqrf\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.997519 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-envoy\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:15.997519 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:15.997495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-token\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.098833 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.098798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-data\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.098833 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.098836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0adb2603-1414-49f2-b3e9-90ac40d23960-istiod-ca-cert\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.098856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-socket\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.098875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvqrf\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-kube-api-access-nvqrf\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.098901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-envoy\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.098927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-token\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.098978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-podinfo\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.099009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-credential-socket\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.099033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-certs\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099493 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.099269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-data\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099493 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.099312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-socket\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099654 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.099629    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0adb2603-1414-49f2-b3e9-90ac40d23960-istiod-ca-cert\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.099838 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.099814    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-credential-socket\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.100018 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.099998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-certs\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.101592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.101565    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-envoy\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.101770 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.101752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-podinfo\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.109576 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.109546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-token\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.109747 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.109729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvqrf\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-kube-api-access-nvqrf\") pod \"e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") " pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.239373 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.239343    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:16.383379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.383356    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"]
Jul 27 21:29:16.385527 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:29:16.385502    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0adb2603_1414_49f2_b3e9_90ac40d23960.slice/crio-0f3313d4f44cbfdd38f352de3576c95e004c87aa2438ea8d22d4746a951a9f8e WatchSource:0}: Error finding container 0f3313d4f44cbfdd38f352de3576c95e004c87aa2438ea8d22d4746a951a9f8e: Status 404 returned error can't find the container with id 0f3313d4f44cbfdd38f352de3576c95e004c87aa2438ea8d22d4746a951a9f8e
Jul 27 21:29:16.388129 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.388087    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:16.388230 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.388177    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:16.388272 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:16.388253    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:17.072497 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:17.072448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" event={"ID":"0adb2603-1414-49f2-b3e9-90ac40d23960","Type":"ContainerStarted","Data":"b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f"}
Jul 27 21:29:17.072897 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:17.072514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" event={"ID":"0adb2603-1414-49f2-b3e9-90ac40d23960","Type":"ContainerStarted","Data":"0f3313d4f44cbfdd38f352de3576c95e004c87aa2438ea8d22d4746a951a9f8e"}
Jul 27 21:29:17.101355 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:17.101306    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" podStartSLOduration=2.101291748 podStartE2EDuration="2.101291748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:29:17.098679864 +0000 UTC m=+1901.364393982" watchObservedRunningTime="2026-07-27 21:29:17.101291748 +0000 UTC m=+1901.367005867"
Jul 27 21:29:17.239721 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:17.239688    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:17.244553 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:17.244532    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:18.079880 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.079843    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:18.080725 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.080704    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:18.568907 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.568867    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"]
Jul 27 21:29:18.573277 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.573256    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.577376 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.577345    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-de98b5e8-serving-cert\""
Jul 27 21:29:18.589367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.589344    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"]
Jul 27 21:29:18.727261 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.727228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85tjx\" (UniqueName: \"kubernetes.io/projected/ced50038-7ea1-4716-be7e-68f330b6d558-kube-api-access-85tjx\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.727462 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.727272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced50038-7ea1-4716-be7e-68f330b6d558-openshift-service-ca\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.727462 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.727420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced50038-7ea1-4716-be7e-68f330b6d558-maas-api-tls\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.827918 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.827841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced50038-7ea1-4716-be7e-68f330b6d558-maas-api-tls\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.827918 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.827884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85tjx\" (UniqueName: \"kubernetes.io/projected/ced50038-7ea1-4716-be7e-68f330b6d558-kube-api-access-85tjx\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.828111 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.827947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced50038-7ea1-4716-be7e-68f330b6d558-openshift-service-ca\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.828622 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.828594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced50038-7ea1-4716-be7e-68f330b6d558-openshift-service-ca\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.830377 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.830356    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced50038-7ea1-4716-be7e-68f330b6d558-maas-api-tls\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.839620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.839599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85tjx\" (UniqueName: \"kubernetes.io/projected/ced50038-7ea1-4716-be7e-68f330b6d558-kube-api-access-85tjx\") pod \"maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:18.884312 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:18.884292    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:19.033022 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.032991    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"]
Jul 27 21:29:19.034331 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:29:19.034298    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced50038_7ea1_4716_be7e_68f330b6d558.slice/crio-9cafd75ea343b7f91c3929f1f7363647365458fe64337a011811209b9a91d25c WatchSource:0}: Error finding container 9cafd75ea343b7f91c3929f1f7363647365458fe64337a011811209b9a91d25c: Status 404 returned error can't find the container with id 9cafd75ea343b7f91c3929f1f7363647365458fe64337a011811209b9a91d25c
Jul 27 21:29:19.035713 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.035696    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:29:19.086344 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.086273    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2" event={"ID":"ced50038-7ea1-4716-be7e-68f330b6d558","Type":"ContainerStarted","Data":"9cafd75ea343b7f91c3929f1f7363647365458fe64337a011811209b9a91d25c"}
Jul 27 21:29:19.410407 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.410175    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"]
Jul 27 21:29:19.415044 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.415018    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:19.418332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.418308    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-de98b5e8\""
Jul 27 21:29:19.426733 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.426712    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"]
Jul 27 21:29:19.533741 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.533700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtqdt\" (UniqueName: \"kubernetes.io/projected/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-kube-api-access-dtqdt\") pod \"payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb\" (UID: \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:19.533923 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.533752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb\" (UID: \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:19.634937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.634903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtqdt\" (UniqueName: \"kubernetes.io/projected/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-kube-api-access-dtqdt\") pod \"payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb\" (UID: \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:19.635109 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.634955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb\" (UID: \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:19.635730 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.635705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb\" (UID: \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:19.643965 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.643941    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtqdt\" (UniqueName: \"kubernetes.io/projected/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-kube-api-access-dtqdt\") pod \"payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb\" (UID: \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:19.726881 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:19.726860    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:20.080638 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:20.080609    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"]
Jul 27 21:29:20.082630 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:29:20.082595    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47fbcee_cfcd_4210_a3ef_8a81543c3c9d.slice/crio-ff7d55850ad688d88c2764c5766e2fe97799bf44ddd3b656b2a6833ebbe2ad4f WatchSource:0}: Error finding container ff7d55850ad688d88c2764c5766e2fe97799bf44ddd3b656b2a6833ebbe2ad4f: Status 404 returned error can't find the container with id ff7d55850ad688d88c2764c5766e2fe97799bf44ddd3b656b2a6833ebbe2ad4f
Jul 27 21:29:20.092723 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:20.092688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2" event={"ID":"ced50038-7ea1-4716-be7e-68f330b6d558","Type":"ContainerStarted","Data":"db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517"}
Jul 27 21:29:20.093099 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:20.092775    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:20.094057 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:20.094031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb" event={"ID":"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d","Type":"ContainerStarted","Data":"ff7d55850ad688d88c2764c5766e2fe97799bf44ddd3b656b2a6833ebbe2ad4f"}
Jul 27 21:29:20.112056 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:20.112006    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2" podStartSLOduration=1.457814639 podStartE2EDuration="2.111987674s" totalImagesPullingTime="654.173035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:29:20.111568248 +0000 UTC m=+1904.377282368" watchObservedRunningTime="2026-07-27 21:29:20.111987674 +0000 UTC m=+1904.377701793"
Jul 27 21:29:21.100438 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:21.100401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb" event={"ID":"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d","Type":"ContainerStarted","Data":"41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6"}
Jul 27 21:29:21.100842 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:21.100494    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:21.118717 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:21.118670    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb" podStartSLOduration=2.118656262 podStartE2EDuration="2.118656262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:29:21.116166326 +0000 UTC m=+1905.381880445" watchObservedRunningTime="2026-07-27 21:29:21.118656262 +0000 UTC m=+1905.384370379"
Jul 27 21:29:26.105908 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:26.105877    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:32.108712 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:32.108635    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:32.166436 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:32.166353    2575 generic.go:356] "Generic (PLEG): container finished" podID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerID="b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f" exitCode=0
Jul 27 21:29:32.166436 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:32.166425    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" event={"ID":"0adb2603-1414-49f2-b3e9-90ac40d23960","Type":"ContainerDied","Data":"b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f"}
Jul 27 21:29:32.166884 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:32.166863    2575 scope.go:117] "RemoveContainer" containerID="b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f"
Jul 27 21:29:32.167986 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:32.167956    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:32.168076 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:32.168027    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:32.168076 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:32.168069    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:33.080690 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:33.080642    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:33.173504 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:33.173468    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" event={"ID":"0adb2603-1414-49f2-b3e9-90ac40d23960","Type":"ContainerStarted","Data":"7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7"}
Jul 27 21:29:33.240118 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:33.240084    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:33.241447 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:33.241410    2575 patch_prober.go:28] interesting pod/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 21:29:33.241596 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:33.241475    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 21:29:34.240770 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:34.240722    2575 patch_prober.go:28] interesting pod/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 21:29:34.241324 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:34.240796    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 21:29:35.240264 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:35.240192    2575 patch_prober.go:28] interesting pod/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 21:29:35.240599 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:35.240549    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 21:29:36.240144 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:36.240098    2575 patch_prober.go:28] interesting pod/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 27 21:29:36.240764 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:36.240166    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 27 21:29:37.244074 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:37.244045    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:37.244580 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:37.244357    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:37.245020 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:37.245004    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:29:54.803177 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:54.803147    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"]
Jul 27 21:29:54.803617 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:54.803389    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2" podUID="ced50038-7ea1-4716-be7e-68f330b6d558" containerName="maas-api" containerID="cri-o://db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517" gracePeriod=30
Jul 27 21:29:54.875167 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:54.875139    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"]
Jul 27 21:29:54.875459 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:54.875404    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb" podUID="f47fbcee-cfcd-4210-a3ef-8a81543c3c9d" containerName="payload-pre-processing" containerID="cri-o://41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6" gracePeriod=30
Jul 27 21:29:55.129931 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.129900    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:55.166154 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.166128    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:55.257623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.257594    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"]
Jul 27 21:29:55.257809 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.257784    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy" containerID="cri-o://7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7" gracePeriod=30
Jul 27 21:29:55.258373 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.258349    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-plugins-config-volume\") pod \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\" (UID: \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\") "
Jul 27 21:29:55.258463 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.258404    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced50038-7ea1-4716-be7e-68f330b6d558-openshift-service-ca\") pod \"ced50038-7ea1-4716-be7e-68f330b6d558\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") "
Jul 27 21:29:55.258463 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.258427    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced50038-7ea1-4716-be7e-68f330b6d558-maas-api-tls\") pod \"ced50038-7ea1-4716-be7e-68f330b6d558\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") "
Jul 27 21:29:55.258557 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.258469    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85tjx\" (UniqueName: \"kubernetes.io/projected/ced50038-7ea1-4716-be7e-68f330b6d558-kube-api-access-85tjx\") pod \"ced50038-7ea1-4716-be7e-68f330b6d558\" (UID: \"ced50038-7ea1-4716-be7e-68f330b6d558\") "
Jul 27 21:29:55.258557 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.258506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtqdt\" (UniqueName: \"kubernetes.io/projected/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-kube-api-access-dtqdt\") pod \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\" (UID: \"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d\") "
Jul 27 21:29:55.258764 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.258734    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f47fbcee-cfcd-4210-a3ef-8a81543c3c9d" (UID: "f47fbcee-cfcd-4210-a3ef-8a81543c3c9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:29:55.258981 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.258954    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ced50038-7ea1-4716-be7e-68f330b6d558-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ced50038-7ea1-4716-be7e-68f330b6d558" (UID: "ced50038-7ea1-4716-be7e-68f330b6d558"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:29:55.261151 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.261124    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-kube-api-access-dtqdt" (OuterVolumeSpecName: "kube-api-access-dtqdt") pod "f47fbcee-cfcd-4210-a3ef-8a81543c3c9d" (UID: "f47fbcee-cfcd-4210-a3ef-8a81543c3c9d"). InnerVolumeSpecName "kube-api-access-dtqdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:29:55.262243 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.262189    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ced50038-7ea1-4716-be7e-68f330b6d558-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ced50038-7ea1-4716-be7e-68f330b6d558" (UID: "ced50038-7ea1-4716-be7e-68f330b6d558"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:29:55.262243 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.262197    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced50038-7ea1-4716-be7e-68f330b6d558-kube-api-access-85tjx" (OuterVolumeSpecName: "kube-api-access-85tjx") pod "ced50038-7ea1-4716-be7e-68f330b6d558" (UID: "ced50038-7ea1-4716-be7e-68f330b6d558"). InnerVolumeSpecName "kube-api-access-85tjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:29:55.286763 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.286729    2575 generic.go:356] "Generic (PLEG): container finished" podID="ced50038-7ea1-4716-be7e-68f330b6d558" containerID="db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517" exitCode=0
Jul 27 21:29:55.286865 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.286775    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"
Jul 27 21:29:55.286865 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.286815    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2" event={"ID":"ced50038-7ea1-4716-be7e-68f330b6d558","Type":"ContainerDied","Data":"db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517"}
Jul 27 21:29:55.286962 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.286863    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2" event={"ID":"ced50038-7ea1-4716-be7e-68f330b6d558","Type":"ContainerDied","Data":"9cafd75ea343b7f91c3929f1f7363647365458fe64337a011811209b9a91d25c"}
Jul 27 21:29:55.286962 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.286893    2575 scope.go:117] "RemoveContainer" containerID="db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517"
Jul 27 21:29:55.288332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.288311    2575 generic.go:356] "Generic (PLEG): container finished" podID="f47fbcee-cfcd-4210-a3ef-8a81543c3c9d" containerID="41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6" exitCode=0
Jul 27 21:29:55.288427 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.288349    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"
Jul 27 21:29:55.288487 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.288347    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb" event={"ID":"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d","Type":"ContainerDied","Data":"41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6"}
Jul 27 21:29:55.288487 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.288475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb" event={"ID":"f47fbcee-cfcd-4210-a3ef-8a81543c3c9d","Type":"ContainerDied","Data":"ff7d55850ad688d88c2764c5766e2fe97799bf44ddd3b656b2a6833ebbe2ad4f"}
Jul 27 21:29:55.297694 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.297679    2575 scope.go:117] "RemoveContainer" containerID="db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517"
Jul 27 21:29:55.298022 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:29:55.297996    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517\": container with ID starting with db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517 not found: ID does not exist" containerID="db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517"
Jul 27 21:29:55.298097 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.298034    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517"} err="failed to get container status \"db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517\": rpc error: code = NotFound desc = could not find container \"db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517\": container with ID starting with db76b76ee730848c6a19d06f02d9a2f6059c394ee24340643f6a449ba6ed4517 not found: ID does not exist"
Jul 27 21:29:55.298097 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.298055    2575 scope.go:117] "RemoveContainer" containerID="41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6"
Jul 27 21:29:55.306148 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.306133    2575 scope.go:117] "RemoveContainer" containerID="41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6"
Jul 27 21:29:55.306414 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:29:55.306398    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6\": container with ID starting with 41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6 not found: ID does not exist" containerID="41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6"
Jul 27 21:29:55.306473 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.306420    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6"} err="failed to get container status \"41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6\": rpc error: code = NotFound desc = could not find container \"41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6\": container with ID starting with 41737171672f5750cc5da3d27fea412561bb89a873790c638f6fef3b7e9bc7c6 not found: ID does not exist"
Jul 27 21:29:55.311851 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.311832    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"]
Jul 27 21:29:55.316560 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.316543    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-de98b5e8-5549bb9bb4-7t6d2"]
Jul 27 21:29:55.332177 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.332158    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"]
Jul 27 21:29:55.337483 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.337435    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-de98b5e8-7b958769cb-5lmdb"]
Jul 27 21:29:55.359990 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.359972    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ced50038-7ea1-4716-be7e-68f330b6d558-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:29:55.360091 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.359991    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ced50038-7ea1-4716-be7e-68f330b6d558-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:29:55.360091 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.360003    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85tjx\" (UniqueName: \"kubernetes.io/projected/ced50038-7ea1-4716-be7e-68f330b6d558-kube-api-access-85tjx\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:29:55.360091 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.360015    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtqdt\" (UniqueName: \"kubernetes.io/projected/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-kube-api-access-dtqdt\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:29:55.360091 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:55.360024    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:29:56.278225 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.278190    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ced50038-7ea1-4716-be7e-68f330b6d558" path="/var/lib/kubelet/pods/ced50038-7ea1-4716-be7e-68f330b6d558/volumes"
Jul 27 21:29:56.278602 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.278578    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f47fbcee-cfcd-4210-a3ef-8a81543c3c9d" path="/var/lib/kubelet/pods/f47fbcee-cfcd-4210-a3ef-8a81543c3c9d/volumes"
Jul 27 21:29:56.424951 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.424918    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"]
Jul 27 21:29:56.425377 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.425362    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced50038-7ea1-4716-be7e-68f330b6d558" containerName="maas-api"
Jul 27 21:29:56.425425 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.425379    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced50038-7ea1-4716-be7e-68f330b6d558" containerName="maas-api"
Jul 27 21:29:56.425425 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.425401    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47fbcee-cfcd-4210-a3ef-8a81543c3c9d" containerName="payload-pre-processing"
Jul 27 21:29:56.425425 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.425408    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47fbcee-cfcd-4210-a3ef-8a81543c3c9d" containerName="payload-pre-processing"
Jul 27 21:29:56.425523 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.425462    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced50038-7ea1-4716-be7e-68f330b6d558" containerName="maas-api"
Jul 27 21:29:56.425523 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.425474    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f47fbcee-cfcd-4210-a3ef-8a81543c3c9d" containerName="payload-pre-processing"
Jul 27 21:29:56.428444 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.428410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.432607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.432580    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3bb019f6-gw-openshift-default-dockercfg-fjmff\""
Jul 27 21:29:56.444832 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.444805    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"]
Jul 27 21:29:56.573571 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-socket\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.573571 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede18906-73d1-43b5-a760-3b1bc715e1fd-istiod-ca-cert\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.573852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-credential-socket\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.573852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-envoy\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.573852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-podinfo\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.573852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4dtl\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-kube-api-access-d4dtl\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.573852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-token\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.573852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-certs\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.573852 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.573744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-data\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674612 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede18906-73d1-43b5-a760-3b1bc715e1fd-istiod-ca-cert\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-credential-socket\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-envoy\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-podinfo\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4dtl\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-kube-api-access-d4dtl\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-token\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-certs\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-data\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.674797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.674798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-socket\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.675242 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.675046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-credential-socket\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.675242 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.675105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-certs\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.675242 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.675186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-socket\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.675433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.675245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-data\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.675535 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.675514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede18906-73d1-43b5-a760-3b1bc715e1fd-istiod-ca-cert\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.677333 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.677313    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-envoy\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.677384 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.677317    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-podinfo\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.686283 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.686261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-token\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.686283 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.686273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4dtl\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-kube-api-access-d4dtl\") pod \"e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") " pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.739406 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.739379    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:56.889498 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.889474    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"]
Jul 27 21:29:56.892020 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:29:56.891995    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede18906_73d1_43b5_a760_3b1bc715e1fd.slice/crio-b263b7b2d5c58fbcde3b216e2174423e9b590a7b949595f986255cde20ad404a WatchSource:0}: Error finding container b263b7b2d5c58fbcde3b216e2174423e9b590a7b949595f986255cde20ad404a: Status 404 returned error can't find the container with id b263b7b2d5c58fbcde3b216e2174423e9b590a7b949595f986255cde20ad404a
Jul 27 21:29:56.894351 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.894321    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:56.894453 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.894396    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:56.894522 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:56.894458    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:29:57.302314 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:57.302274    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" event={"ID":"ede18906-73d1-43b5-a760-3b1bc715e1fd","Type":"ContainerStarted","Data":"78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e"}
Jul 27 21:29:57.302797 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:57.302341    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" event={"ID":"ede18906-73d1-43b5-a760-3b1bc715e1fd","Type":"ContainerStarted","Data":"b263b7b2d5c58fbcde3b216e2174423e9b590a7b949595f986255cde20ad404a"}
Jul 27 21:29:57.333030 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:57.332972    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" podStartSLOduration=1.332957311 podStartE2EDuration="1.332957311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:29:57.330072097 +0000 UTC m=+1941.595786214" watchObservedRunningTime="2026-07-27 21:29:57.332957311 +0000 UTC m=+1941.598671428"
Jul 27 21:29:57.740062 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:57.740025    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:57.745105 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:57.745080    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:58.307221 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:58.307182    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:58.308239 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:58.308198    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:29:59.777278 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:59.777242    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"]
Jul 27 21:29:59.781130 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:59.781108    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:29:59.783639 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:59.783618    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3bb019f6\""
Jul 27 21:29:59.790094 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:59.790067    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"]
Jul 27 21:29:59.906036 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:59.906000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfmhp\" (UniqueName: \"kubernetes.io/projected/9c274ee3-ce24-4497-a7e2-9198a5ca8881-kube-api-access-hfmhp\") pod \"payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr\" (UID: \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:29:59.906269 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:29:59.906052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c274ee3-ce24-4497-a7e2-9198a5ca8881-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr\" (UID: \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:00.007150 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.007109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfmhp\" (UniqueName: \"kubernetes.io/projected/9c274ee3-ce24-4497-a7e2-9198a5ca8881-kube-api-access-hfmhp\") pod \"payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr\" (UID: \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:00.007150 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.007153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c274ee3-ce24-4497-a7e2-9198a5ca8881-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr\" (UID: \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:00.007863 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.007844    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c274ee3-ce24-4497-a7e2-9198a5ca8881-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr\" (UID: \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:00.016506 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.016474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfmhp\" (UniqueName: \"kubernetes.io/projected/9c274ee3-ce24-4497-a7e2-9198a5ca8881-kube-api-access-hfmhp\") pod \"payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr\" (UID: \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:00.092305 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.092237    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:00.444946 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.444913    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"]
Jul 27 21:30:00.450099 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:30:00.450068    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c274ee3_ce24_4497_a7e2_9198a5ca8881.slice/crio-7a3a2ed50d4488b21319bfbced07415edb90d1eecb1bbc24c78014edb9cf80cf WatchSource:0}: Error finding container 7a3a2ed50d4488b21319bfbced07415edb90d1eecb1bbc24c78014edb9cf80cf: Status 404 returned error can't find the container with id 7a3a2ed50d4488b21319bfbced07415edb90d1eecb1bbc24c78014edb9cf80cf
Jul 27 21:30:00.509836 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.509813    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:30:00.614219 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614190    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-certs\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614262    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-podinfo\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614296    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-token\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614323    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-credential-socket\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614349    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-socket\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614382    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0adb2603-1414-49f2-b3e9-90ac40d23960-istiod-ca-cert\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614430    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-data\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614455    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvqrf\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-kube-api-access-nvqrf\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614489    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-envoy\") pod \"0adb2603-1414-49f2-b3e9-90ac40d23960\" (UID: \"0adb2603-1414-49f2-b3e9-90ac40d23960\") "
Jul 27 21:30:00.614657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614486    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:00.614657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614616    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:00.614657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614647    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:00.614943 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614752    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0adb2603-1414-49f2-b3e9-90ac40d23960-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:00.614991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614942    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:00.614991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614960    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-credential-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:00.614991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614975    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-workload-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:00.615129 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.614990    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0adb2603-1414-49f2-b3e9-90ac40d23960-istiod-ca-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:00.615354 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.615308    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-data" (OuterVolumeSpecName: "istio-data") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:00.616811 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.616787    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:00.617081 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.617064    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:30:00.617273 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.617249    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-kube-api-access-nvqrf" (OuterVolumeSpecName: "kube-api-access-nvqrf") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "kube-api-access-nvqrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:00.617273 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.617264    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-token" (OuterVolumeSpecName: "istio-token") pod "0adb2603-1414-49f2-b3e9-90ac40d23960" (UID: "0adb2603-1414-49f2-b3e9-90ac40d23960"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:00.716580 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.716504    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-envoy\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:00.716580 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.716536    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-podinfo\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:00.716580 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.716549    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:00.716580 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.716562    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0adb2603-1414-49f2-b3e9-90ac40d23960-istio-data\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:00.716580 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:00.716575    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvqrf\" (UniqueName: \"kubernetes.io/projected/0adb2603-1414-49f2-b3e9-90ac40d23960-kube-api-access-nvqrf\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:01.325420 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.325329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr" event={"ID":"9c274ee3-ce24-4497-a7e2-9198a5ca8881","Type":"ContainerStarted","Data":"03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896"}
Jul 27 21:30:01.325420 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.325396    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr" event={"ID":"9c274ee3-ce24-4497-a7e2-9198a5ca8881","Type":"ContainerStarted","Data":"7a3a2ed50d4488b21319bfbced07415edb90d1eecb1bbc24c78014edb9cf80cf"}
Jul 27 21:30:01.325907 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.325555    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:01.327010 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.326987    2575 generic.go:356] "Generic (PLEG): container finished" podID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerID="7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7" exitCode=0
Jul 27 21:30:01.327147 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.327027    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"
Jul 27 21:30:01.327147 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.327029    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" event={"ID":"0adb2603-1414-49f2-b3e9-90ac40d23960","Type":"ContainerDied","Data":"7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7"}
Jul 27 21:30:01.327147 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.327072    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl" event={"ID":"0adb2603-1414-49f2-b3e9-90ac40d23960","Type":"ContainerDied","Data":"0f3313d4f44cbfdd38f352de3576c95e004c87aa2438ea8d22d4746a951a9f8e"}
Jul 27 21:30:01.327147 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.327102    2575 scope.go:117] "RemoveContainer" containerID="7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7"
Jul 27 21:30:01.336451 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.336435    2575 scope.go:117] "RemoveContainer" containerID="b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f"
Jul 27 21:30:01.343903 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.343862    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr" podStartSLOduration=2.343848666 podStartE2EDuration="2.343848666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:01.342517767 +0000 UTC m=+1945.608231885" watchObservedRunningTime="2026-07-27 21:30:01.343848666 +0000 UTC m=+1945.609562784"
Jul 27 21:30:01.345565 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.345548    2575 scope.go:117] "RemoveContainer" containerID="7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7"
Jul 27 21:30:01.345854 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:30:01.345833    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7\": container with ID starting with 7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7 not found: ID does not exist" containerID="7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7"
Jul 27 21:30:01.345966 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.345857    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7"} err="failed to get container status \"7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7\": rpc error: code = NotFound desc = could not find container \"7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7\": container with ID starting with 7ef29f91051dd232863728482774f5ff32035b0f619799805fdc8691798d5fe7 not found: ID does not exist"
Jul 27 21:30:01.345966 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.345873    2575 scope.go:117] "RemoveContainer" containerID="b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f"
Jul 27 21:30:01.346119 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:30:01.346076    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f\": container with ID starting with b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f not found: ID does not exist" containerID="b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f"
Jul 27 21:30:01.346119 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.346096    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f"} err="failed to get container status \"b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f\": rpc error: code = NotFound desc = could not find container \"b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f\": container with ID starting with b26572983e0a395099acd31c5ae331a9358ca0534f43b7268247641a958b3b2f not found: ID does not exist"
Jul 27 21:30:01.359583 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.359561    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"]
Jul 27 21:30:01.363877 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:01.363849    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-de98b5e8-openshift-default-5c87bc7f9b-tkdtl"]
Jul 27 21:30:02.278437 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:02.278401    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" path="/var/lib/kubelet/pods/0adb2603-1414-49f2-b3e9-90ac40d23960/volumes"
Jul 27 21:30:12.335786 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:12.335761    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:13.308388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:13.308355    2575 patch_prober.go:28] interesting pod/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:30:13.308576 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:13.308427    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:30:13.394552 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:13.394521    2575 generic.go:356] "Generic (PLEG): container finished" podID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerID="78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e" exitCode=0
Jul 27 21:30:13.394907 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:13.394588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" event={"ID":"ede18906-73d1-43b5-a760-3b1bc715e1fd","Type":"ContainerDied","Data":"78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e"}
Jul 27 21:30:13.395014 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:13.394999    2575 scope.go:117] "RemoveContainer" containerID="78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e"
Jul 27 21:30:13.396051 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:13.396021    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:13.396164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:13.396108    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:13.396164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:13.396154    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:14.402181 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:14.402149    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" event={"ID":"ede18906-73d1-43b5-a760-3b1bc715e1fd","Type":"ContainerStarted","Data":"5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c"}
Jul 27 21:30:14.740149 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:14.740118    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:30:14.740517 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:14.740479    2575 patch_prober.go:28] interesting pod/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:30:14.740641 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:14.740569    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:30:15.740201 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:15.740156    2575 patch_prober.go:28] interesting pod/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:30:15.740697 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:15.740247    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:30:16.740549 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:16.740503    2575 patch_prober.go:28] interesting pod/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:30:16.741159 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:16.741127    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:30:17.740535 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:17.740491    2575 patch_prober.go:28] interesting pod/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 27 21:30:17.740754 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:17.740565    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 27 21:30:18.743740 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:18.743713    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:30:18.744137 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:18.744096    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:30:18.744683 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:18.744668    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:30:34.567725 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.567517    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"]
Jul 27 21:30:34.568769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.568733    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr" podUID="9c274ee3-ce24-4497-a7e2-9198a5ca8881" containerName="payload-pre-processing" containerID="cri-o://03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896" gracePeriod=30
Jul 27 21:30:34.844047 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.844002    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:34.906238 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.901308    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"]
Jul 27 21:30:34.906238 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.901693    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy" containerID="cri-o://5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c" gracePeriod=30
Jul 27 21:30:34.942003 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.941972    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c274ee3-ce24-4497-a7e2-9198a5ca8881-plugins-config-volume\") pod \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\" (UID: \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\") "
Jul 27 21:30:34.942194 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.942037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfmhp\" (UniqueName: \"kubernetes.io/projected/9c274ee3-ce24-4497-a7e2-9198a5ca8881-kube-api-access-hfmhp\") pod \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\" (UID: \"9c274ee3-ce24-4497-a7e2-9198a5ca8881\") "
Jul 27 21:30:34.942432 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.942408    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c274ee3-ce24-4497-a7e2-9198a5ca8881-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c274ee3-ce24-4497-a7e2-9198a5ca8881" (UID: "9c274ee3-ce24-4497-a7e2-9198a5ca8881"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:34.944330 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:34.944300    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c274ee3-ce24-4497-a7e2-9198a5ca8881-kube-api-access-hfmhp" (OuterVolumeSpecName: "kube-api-access-hfmhp") pod "9c274ee3-ce24-4497-a7e2-9198a5ca8881" (UID: "9c274ee3-ce24-4497-a7e2-9198a5ca8881"). InnerVolumeSpecName "kube-api-access-hfmhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:35.043004 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.042969    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c274ee3-ce24-4497-a7e2-9198a5ca8881-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:35.043004 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.042997    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfmhp\" (UniqueName: \"kubernetes.io/projected/9c274ee3-ce24-4497-a7e2-9198a5ca8881-kube-api-access-hfmhp\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:35.513292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.513253    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c274ee3-ce24-4497-a7e2-9198a5ca8881" containerID="03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896" exitCode=0
Jul 27 21:30:35.513497 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.513315    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"
Jul 27 21:30:35.513497 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.513353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr" event={"ID":"9c274ee3-ce24-4497-a7e2-9198a5ca8881","Type":"ContainerDied","Data":"03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896"}
Jul 27 21:30:35.513497 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.513420    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr" event={"ID":"9c274ee3-ce24-4497-a7e2-9198a5ca8881","Type":"ContainerDied","Data":"7a3a2ed50d4488b21319bfbced07415edb90d1eecb1bbc24c78014edb9cf80cf"}
Jul 27 21:30:35.513497 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.513452    2575 scope.go:117] "RemoveContainer" containerID="03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896"
Jul 27 21:30:35.522916 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.522899    2575 scope.go:117] "RemoveContainer" containerID="03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896"
Jul 27 21:30:35.523231 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:30:35.523194    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896\": container with ID starting with 03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896 not found: ID does not exist" containerID="03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896"
Jul 27 21:30:35.523296 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.523238    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896"} err="failed to get container status \"03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896\": rpc error: code = NotFound desc = could not find container \"03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896\": container with ID starting with 03114c2e6285666a611a82cca38c3b105e619aee0550dc7158ecdec45b060896 not found: ID does not exist"
Jul 27 21:30:35.537800 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.537777    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"]
Jul 27 21:30:35.543783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.543761    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3bb019f6-7fb4978b64-4rlqr"]
Jul 27 21:30:35.700128 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700096    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"]
Jul 27 21:30:35.700616 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700601    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy"
Jul 27 21:30:35.700616 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700614    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy"
Jul 27 21:30:35.700736 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700630    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c274ee3-ce24-4497-a7e2-9198a5ca8881" containerName="payload-pre-processing"
Jul 27 21:30:35.700736 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700637    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c274ee3-ce24-4497-a7e2-9198a5ca8881" containerName="payload-pre-processing"
Jul 27 21:30:35.700736 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700650    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy"
Jul 27 21:30:35.700736 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700655    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy"
Jul 27 21:30:35.700736 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700712    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c274ee3-ce24-4497-a7e2-9198a5ca8881" containerName="payload-pre-processing"
Jul 27 21:30:35.700736 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.700722    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy"
Jul 27 21:30:35.705154 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.705135    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.707449 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.707428    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0d4e25e7-openshift-default-dockercfg-5frdv\""
Jul 27 21:30:35.720415 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.720340    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"]
Jul 27 21:30:35.748713 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.748682    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-token\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.748911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.748730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-socket\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.748911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.748760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6hrh\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-kube-api-access-n6hrh\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.748911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.748859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-envoy\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.749079 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.748933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-podinfo\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.749079 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.748972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-credential-socket\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.749079 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.748997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istiod-ca-cert\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.749231 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.749099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-data\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.749231 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.749127    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-certs\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850490 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6hrh\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-kube-api-access-n6hrh\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850490 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-envoy\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850718 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-podinfo\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850718 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850546    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-credential-socket\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850718 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istiod-ca-cert\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850718 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-data\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850718 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-certs\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850988 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-token\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.850988 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-socket\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.851097 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.850987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-credential-socket\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.851097 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.851069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-certs\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.851203 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.851117    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-data\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.851310 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.851279    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-socket\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.851837 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.851813    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istiod-ca-cert\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.853134 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.853112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-envoy\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.853361 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.853341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-podinfo\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.869914 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.869879    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6hrh\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-kube-api-access-n6hrh\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:35.871900 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:35.871874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-token\") pod \"e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") " pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:36.015623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.015593    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:36.175340 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.175313    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"]
Jul 27 21:30:36.177058 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:30:36.177029    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b58fcb_d1d9_40d9_953d_5a1ad35691c7.slice/crio-e252a44964f50502417553319ed66d244aa7358ce48553bb3a1bafe0c8510d5e WatchSource:0}: Error finding container e252a44964f50502417553319ed66d244aa7358ce48553bb3a1bafe0c8510d5e: Status 404 returned error can't find the container with id e252a44964f50502417553319ed66d244aa7358ce48553bb3a1bafe0c8510d5e
Jul 27 21:30:36.179106 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.179077    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:36.179183 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.179137    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:36.179183 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.179170    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:36.279451 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.279421    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c274ee3-ce24-4497-a7e2-9198a5ca8881" path="/var/lib/kubelet/pods/9c274ee3-ce24-4497-a7e2-9198a5ca8881/volumes"
Jul 27 21:30:36.520239 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.520189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" event={"ID":"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7","Type":"ContainerStarted","Data":"a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454"}
Jul 27 21:30:36.520415 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.520255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" event={"ID":"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7","Type":"ContainerStarted","Data":"e252a44964f50502417553319ed66d244aa7358ce48553bb3a1bafe0c8510d5e"}
Jul 27 21:30:36.545890 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:36.545834    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" podStartSLOduration=1.545819083 podStartE2EDuration="1.545819083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:30:36.543440489 +0000 UTC m=+1980.809154607" watchObservedRunningTime="2026-07-27 21:30:36.545819083 +0000 UTC m=+1980.811533200"
Jul 27 21:30:37.015960 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:37.015930    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:37.020958 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:37.020927    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:37.525788 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:37.525759    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:37.526855 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:37.526836    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:40.184926 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.184870    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:30:40.296243 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296183    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-certs\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296255    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-socket\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296283    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-podinfo\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-credential-socket\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296390    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede18906-73d1-43b5-a760-3b1bc715e1fd-istiod-ca-cert\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296418    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-data\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296443    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:40.296734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296462    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-token\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296507    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4dtl\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-kube-api-access-d4dtl\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296556    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-envoy\") pod \"ede18906-73d1-43b5-a760-3b1bc715e1fd\" (UID: \"ede18906-73d1-43b5-a760-3b1bc715e1fd\") "
Jul 27 21:30:40.296734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296575    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:40.296734 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296651    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:40.297051 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296860    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.297051 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296883    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-workload-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.297051 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.296900    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-credential-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.297401 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.297068    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ede18906-73d1-43b5-a760-3b1bc715e1fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:30:40.297401 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.297254    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:40.298786 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.298763    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:40.298896 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.298782    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-kube-api-access-d4dtl" (OuterVolumeSpecName: "kube-api-access-d4dtl") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "kube-api-access-d4dtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:30:40.299185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.299168    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:30:40.299273 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.299177    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ede18906-73d1-43b5-a760-3b1bc715e1fd" (UID: "ede18906-73d1-43b5-a760-3b1bc715e1fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:30:40.397574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.397542    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-envoy\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.397574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.397572    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-podinfo\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.397574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.397583    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede18906-73d1-43b5-a760-3b1bc715e1fd-istiod-ca-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.397884 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.397595    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-data\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.397884 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.397606    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-istio-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.397884 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.397616    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4dtl\" (UniqueName: \"kubernetes.io/projected/ede18906-73d1-43b5-a760-3b1bc715e1fd-kube-api-access-d4dtl\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:30:40.544668 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.544639    2575 generic.go:356] "Generic (PLEG): container finished" podID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerID="5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c" exitCode=0
Jul 27 21:30:40.544835 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.544695    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"
Jul 27 21:30:40.544835 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.544743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" event={"ID":"ede18906-73d1-43b5-a760-3b1bc715e1fd","Type":"ContainerDied","Data":"5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c"}
Jul 27 21:30:40.544835 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.544803    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5" event={"ID":"ede18906-73d1-43b5-a760-3b1bc715e1fd","Type":"ContainerDied","Data":"b263b7b2d5c58fbcde3b216e2174423e9b590a7b949595f986255cde20ad404a"}
Jul 27 21:30:40.544835 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.544826    2575 scope.go:117] "RemoveContainer" containerID="5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c"
Jul 27 21:30:40.556157 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.555325    2575 scope.go:117] "RemoveContainer" containerID="78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e"
Jul 27 21:30:40.564520 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.564500    2575 scope.go:117] "RemoveContainer" containerID="5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c"
Jul 27 21:30:40.565023 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:30:40.564845    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c\": container with ID starting with 5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c not found: ID does not exist" containerID="5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c"
Jul 27 21:30:40.565023 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.564885    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c"} err="failed to get container status \"5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c\": rpc error: code = NotFound desc = could not find container \"5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c\": container with ID starting with 5a383d6c80d3a3ea5af861fefbe5c31351e292a391cdbc8e358a3609c6cbca6c not found: ID does not exist"
Jul 27 21:30:40.565023 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.564909    2575 scope.go:117] "RemoveContainer" containerID="78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e"
Jul 27 21:30:40.565374 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:30:40.565236    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e\": container with ID starting with 78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e not found: ID does not exist" containerID="78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e"
Jul 27 21:30:40.565374 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.565288    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e"} err="failed to get container status \"78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e\": rpc error: code = NotFound desc = could not find container \"78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e\": container with ID starting with 78ba88ab14fd2e9a236de4af0cfeeaca83e490c5d0f598cca751d5a8718af21e not found: ID does not exist"
Jul 27 21:30:40.567392 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.567373    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"]
Jul 27 21:30:40.571051 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:40.571029    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3bb019f6-gw-openshift-default-6868f87fcb-6jds5"]
Jul 27 21:30:42.278971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:42.278938    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" path="/var/lib/kubelet/pods/ede18906-73d1-43b5-a760-3b1bc715e1fd/volumes"
Jul 27 21:30:52.527915 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:52.527878    2575 patch_prober.go:28] interesting pod/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:30:52.528382 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:52.527958    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:30:52.607381 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:52.607351    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerID="a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454" exitCode=0
Jul 27 21:30:52.607531 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:52.607406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" event={"ID":"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7","Type":"ContainerDied","Data":"a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454"}
Jul 27 21:30:52.607810 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:52.607797    2575 scope.go:117] "RemoveContainer" containerID="a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454"
Jul 27 21:30:52.608874 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:52.608844    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:52.608949 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:52.608934    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:52.608994 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:52.608973    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:30:53.614946 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:53.614915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" event={"ID":"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7","Type":"ContainerStarted","Data":"9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb"}
Jul 27 21:30:54.016276 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:54.016239    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:54.016465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:54.016449    2575 patch_prober.go:28] interesting pod/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:30:54.016540 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:54.016490    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:30:55.016810 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:55.016764    2575 patch_prober.go:28] interesting pod/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:30:55.017332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:55.016850    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:30:56.016588 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:56.016552    2575 patch_prober.go:28] interesting pod/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:30:56.016795 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:56.016605    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:30:57.016453 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:57.016420    2575 patch_prober.go:28] interesting pod/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 27 21:30:57.016841 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:57.016473    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 27 21:30:58.021088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:58.021059    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:58.021522 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:58.021397    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:30:58.022041 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:30:58.022021    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:31:15.979890 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:15.979858    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"]
Jul 27 21:31:15.980419 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:15.980060    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy" containerID="cri-o://9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb" gracePeriod=30
Jul 27 21:31:16.805119 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.805086    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"]
Jul 27 21:31:16.805724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.805708    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy"
Jul 27 21:31:16.805781 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.805728    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy"
Jul 27 21:31:16.805781 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.805765    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy"
Jul 27 21:31:16.805781 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.805775    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy"
Jul 27 21:31:16.805882 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.805860    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy"
Jul 27 21:31:16.805882 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.805876    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0adb2603-1414-49f2-b3e9-90ac40d23960" containerName="istio-proxy"
Jul 27 21:31:16.809318 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.809299    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.813502 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.813474    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-51e5669d-openshift-default-dockercfg-lwwx4\""
Jul 27 21:31:16.827019 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.826992    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"]
Jul 27 21:31:16.931991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.931959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-credential-socket\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.931991 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.932002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9d315b9-0597-480a-8961-0018c6e6c0ce-istiod-ca-cert\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.932256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.932038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-envoy\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.932256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.932056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-socket\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.932256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.932081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-podinfo\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.932256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.932108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-certs\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.932256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.932125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-data\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.932256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.932142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlspw\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-kube-api-access-nlspw\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:16.932256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:16.932162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-token\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033440 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-podinfo\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-certs\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-data\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlspw\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-kube-api-access-nlspw\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-token\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-credential-socket\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9d315b9-0597-480a-8961-0018c6e6c0ce-istiod-ca-cert\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-envoy\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-socket\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.033887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033881    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-certs\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.034409 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.033953    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-data\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.034409 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.034018    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-socket\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.034409 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.034116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-credential-socket\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.034608 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.034589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9d315b9-0597-480a-8961-0018c6e6c0ce-istiod-ca-cert\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.036782 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.036759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-envoy\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.037095 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.037074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-podinfo\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.048652 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.048628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-token\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.048911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.048892    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlspw\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-kube-api-access-nlspw\") pod \"e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") " pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.120527 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.120456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:17.268068 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.268042    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"]
Jul 27 21:31:17.269647 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:31:17.269624    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d315b9_0597_480a_8961_0018c6e6c0ce.slice/crio-7f25ae2df0301d7b456592020b8eaed10bf7541707fd532a359e300d7854c1f2 WatchSource:0}: Error finding container 7f25ae2df0301d7b456592020b8eaed10bf7541707fd532a359e300d7854c1f2: Status 404 returned error can't find the container with id 7f25ae2df0301d7b456592020b8eaed10bf7541707fd532a359e300d7854c1f2
Jul 27 21:31:17.271656 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.271628    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:31:17.271724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.271690    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:31:17.271724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.271716    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:31:17.739339 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.739300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" event={"ID":"e9d315b9-0597-480a-8961-0018c6e6c0ce","Type":"ContainerStarted","Data":"c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96"}
Jul 27 21:31:17.739536 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.739355    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" event={"ID":"e9d315b9-0597-480a-8961-0018c6e6c0ce","Type":"ContainerStarted","Data":"7f25ae2df0301d7b456592020b8eaed10bf7541707fd532a359e300d7854c1f2"}
Jul 27 21:31:17.762401 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:17.762342    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" podStartSLOduration=1.762326005 podStartE2EDuration="1.762326005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:31:17.760620403 +0000 UTC m=+2022.026334522" watchObservedRunningTime="2026-07-27 21:31:17.762326005 +0000 UTC m=+2022.028040122"
Jul 27 21:31:18.121609 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:18.121536    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:18.126520 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:18.126497    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:18.744590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:18.744563    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:18.745587 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:18.745563    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:19.978428 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:19.978392    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"]
Jul 27 21:31:19.978901 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:19.978886    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede18906-73d1-43b5-a760-3b1bc715e1fd" containerName="istio-proxy"
Jul 27 21:31:19.982001 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:19.981985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:19.984413 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:19.984390    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-51e5669d\""
Jul 27 21:31:19.984533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:19.984431    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-51e5669d-dockercfg-jv62m\""
Jul 27 21:31:19.994461 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:19.994440    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"]
Jul 27 21:31:20.062041 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.062002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-plugins-config-volume\") pod \"payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz\" (UID: \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\") " pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:20.062256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.062075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fbc8\" (UniqueName: \"kubernetes.io/projected/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-kube-api-access-9fbc8\") pod \"payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz\" (UID: \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\") " pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:20.163341 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.163304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fbc8\" (UniqueName: \"kubernetes.io/projected/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-kube-api-access-9fbc8\") pod \"payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz\" (UID: \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\") " pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:20.163516 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.163460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-plugins-config-volume\") pod \"payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz\" (UID: \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\") " pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:20.164150 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.164131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-plugins-config-volume\") pod \"payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz\" (UID: \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\") " pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:20.175067 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.175038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fbc8\" (UniqueName: \"kubernetes.io/projected/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-kube-api-access-9fbc8\") pod \"payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz\" (UID: \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\") " pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:20.293877 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.293850    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:20.441759 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.441728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"]
Jul 27 21:31:20.444457 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:31:20.444421    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2c16bf_1fd4_48b1_ac44_06f7535beb9a.slice/crio-2352510ee1bbd99a42f2a77110b36462faf1440a39bc39d4011447008aef93f8 WatchSource:0}: Error finding container 2352510ee1bbd99a42f2a77110b36462faf1440a39bc39d4011447008aef93f8: Status 404 returned error can't find the container with id 2352510ee1bbd99a42f2a77110b36462faf1440a39bc39d4011447008aef93f8
Jul 27 21:31:20.756274 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.756236    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz" event={"ID":"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a","Type":"ContainerStarted","Data":"a50faf337700727383b7771233e08706d5d6ca6f6bc730c83d638ec7dfdddf27"}
Jul 27 21:31:20.756472 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.756298    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz" event={"ID":"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a","Type":"ContainerStarted","Data":"2352510ee1bbd99a42f2a77110b36462faf1440a39bc39d4011447008aef93f8"}
Jul 27 21:31:20.756564 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.756547    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:20.778228 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:20.778170    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz" podStartSLOduration=1.778153758 podStartE2EDuration="1.778153758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:31:20.77804309 +0000 UTC m=+2025.043757211" watchObservedRunningTime="2026-07-27 21:31:20.778153758 +0000 UTC m=+2025.043867881"
Jul 27 21:31:21.247256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.247226    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:31:21.375971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.375888    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-envoy\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.375971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.375936    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-data\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.376189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.375974    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istiod-ca-cert\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.376189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376020    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-token\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.376189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376045    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-podinfo\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.376189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376090    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-socket\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.376189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376114    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6hrh\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-kube-api-access-n6hrh\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.376189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376175    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-credential-socket\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.376535 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376244    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-certs\") pod \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\" (UID: \"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7\") "
Jul 27 21:31:21.376535 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376420    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:21.376668 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376647    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istiod-ca-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.377590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376669    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:31:21.377590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376833    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:31:21.377590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376863    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:31:21.377590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.376979    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:31:21.378763 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.378733    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:31:21.379088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.379060    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:31:21.379370 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.379346    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-kube-api-access-n6hrh" (OuterVolumeSpecName: "kube-api-access-n6hrh") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "kube-api-access-n6hrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:31:21.379793 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.379777    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" (UID: "b9b58fcb-d1d9-40d9-953d-5a1ad35691c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:31:21.477547 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.477516    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-credential-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.477547 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.477541    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.477547 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.477551    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-envoy\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.477768 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.477558    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-data\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.477768 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.477566    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.477768 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.477573    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-istio-podinfo\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.477768 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.477581    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-workload-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.477768 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.477589    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6hrh\" (UniqueName: \"kubernetes.io/projected/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7-kube-api-access-n6hrh\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:21.763038 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.763001    2575 generic.go:356] "Generic (PLEG): container finished" podID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerID="9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb" exitCode=0
Jul 27 21:31:21.763191 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.763055    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"
Jul 27 21:31:21.763191 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.763082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" event={"ID":"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7","Type":"ContainerDied","Data":"9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb"}
Jul 27 21:31:21.763191 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.763138    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9" event={"ID":"b9b58fcb-d1d9-40d9-953d-5a1ad35691c7","Type":"ContainerDied","Data":"e252a44964f50502417553319ed66d244aa7358ce48553bb3a1bafe0c8510d5e"}
Jul 27 21:31:21.763191 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.763161    2575 scope.go:117] "RemoveContainer" containerID="9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb"
Jul 27 21:31:21.772922 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.772903    2575 scope.go:117] "RemoveContainer" containerID="a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454"
Jul 27 21:31:21.781000 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.780983    2575 scope.go:117] "RemoveContainer" containerID="9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb"
Jul 27 21:31:21.781270 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:31:21.781249    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb\": container with ID starting with 9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb not found: ID does not exist" containerID="9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb"
Jul 27 21:31:21.781342 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.781277    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb"} err="failed to get container status \"9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb\": rpc error: code = NotFound desc = could not find container \"9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb\": container with ID starting with 9b255d4ff4e7f91429aa93df41f4624e0c533a09298cd74e411f37275fdebfdb not found: ID does not exist"
Jul 27 21:31:21.781342 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.781294    2575 scope.go:117] "RemoveContainer" containerID="a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454"
Jul 27 21:31:21.781528 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:31:21.781514    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454\": container with ID starting with a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454 not found: ID does not exist" containerID="a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454"
Jul 27 21:31:21.781568 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.781533    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454"} err="failed to get container status \"a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454\": rpc error: code = NotFound desc = could not find container \"a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454\": container with ID starting with a9dd015d645e2a6cfa04fc86079f716bfd39ff3c03487bf75775fae82daf2454 not found: ID does not exist"
Jul 27 21:31:21.786106 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.786085    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"]
Jul 27 21:31:21.792689 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:21.792669    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0d4e25e7-openshift-default-5d8d49bf5b-gf6t9"]
Jul 27 21:31:22.279040 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:22.279004    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" path="/var/lib/kubelet/pods/b9b58fcb-d1d9-40d9-953d-5a1ad35691c7/volumes"
Jul 27 21:31:31.765748 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:31.765718    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:32.823924 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:32.823892    2575 generic.go:356] "Generic (PLEG): container finished" podID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerID="c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96" exitCode=0
Jul 27 21:31:32.824375 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:32.823963    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" event={"ID":"e9d315b9-0597-480a-8961-0018c6e6c0ce","Type":"ContainerDied","Data":"c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96"}
Jul 27 21:31:32.824428 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:32.824390    2575 scope.go:117] "RemoveContainer" containerID="c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96"
Jul 27 21:31:32.825395 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:32.825371    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:31:32.825464 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:32.825437    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:31:32.825502 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:32.825469    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:31:33.744985 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:33.744950    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:33.831714 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:33.831669    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" event={"ID":"e9d315b9-0597-480a-8961-0018c6e6c0ce","Type":"ContainerStarted","Data":"f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841"}
Jul 27 21:31:34.121461 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:34.121358    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:34.122680 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:34.122654    2575 patch_prober.go:28] interesting pod/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:31:34.122824 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:34.122703    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:31:35.121164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:35.121130    2575 patch_prober.go:28] interesting pod/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:31:35.121583 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:35.121187    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:31:36.121615 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:36.121579    2575 patch_prober.go:28] interesting pod/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:31:36.121989 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:36.121638    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:31:37.121642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:37.121598    2575 patch_prober.go:28] interesting pod/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 27 21:31:37.122034 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:37.121656    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 27 21:31:38.124982 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:38.124941    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:38.125380 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:38.125247    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:38.125979 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:38.125956    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:31:54.766945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:54.766898    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"]
Jul 27 21:31:54.767589 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:54.767235    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz" podUID="5c2c16bf-1fd4-48b1-ac44-06f7535beb9a" containerName="payload-processing" containerID="cri-o://a50faf337700727383b7771233e08706d5d6ca6f6bc730c83d638ec7dfdddf27" gracePeriod=30
Jul 27 21:31:54.968084 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:54.967879    2575 generic.go:356] "Generic (PLEG): container finished" podID="5c2c16bf-1fd4-48b1-ac44-06f7535beb9a" containerID="a50faf337700727383b7771233e08706d5d6ca6f6bc730c83d638ec7dfdddf27" exitCode=0
Jul 27 21:31:54.968084 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:54.967989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz" event={"ID":"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a","Type":"ContainerDied","Data":"a50faf337700727383b7771233e08706d5d6ca6f6bc730c83d638ec7dfdddf27"}
Jul 27 21:31:55.026427 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.026371    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:55.111349 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.111308    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fbc8\" (UniqueName: \"kubernetes.io/projected/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-kube-api-access-9fbc8\") pod \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\" (UID: \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\") "
Jul 27 21:31:55.111553 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.111371    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-plugins-config-volume\") pod \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\" (UID: \"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a\") "
Jul 27 21:31:55.111873 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.111830    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c2c16bf-1fd4-48b1-ac44-06f7535beb9a" (UID: "5c2c16bf-1fd4-48b1-ac44-06f7535beb9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:31:55.113731 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.113705    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-kube-api-access-9fbc8" (OuterVolumeSpecName: "kube-api-access-9fbc8") pod "5c2c16bf-1fd4-48b1-ac44-06f7535beb9a" (UID: "5c2c16bf-1fd4-48b1-ac44-06f7535beb9a"). InnerVolumeSpecName "kube-api-access-9fbc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:31:55.189550 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.189512    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"]
Jul 27 21:31:55.189769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.189726    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy" containerID="cri-o://f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841" gracePeriod=30
Jul 27 21:31:55.212394 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.212357    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fbc8\" (UniqueName: \"kubernetes.io/projected/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-kube-api-access-9fbc8\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:55.212394 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.212389    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:31:55.975111 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.975080    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"
Jul 27 21:31:55.975111 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.975088    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz" event={"ID":"5c2c16bf-1fd4-48b1-ac44-06f7535beb9a","Type":"ContainerDied","Data":"2352510ee1bbd99a42f2a77110b36462faf1440a39bc39d4011447008aef93f8"}
Jul 27 21:31:55.975629 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:55.975155    2575 scope.go:117] "RemoveContainer" containerID="a50faf337700727383b7771233e08706d5d6ca6f6bc730c83d638ec7dfdddf27"
Jul 27 21:31:56.014499 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:56.014465    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"]
Jul 27 21:31:56.019272 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:56.019243    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-51e5669d-69b8f4746-hq7mz"]
Jul 27 21:31:56.277731 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:31:56.277694    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c2c16bf-1fd4-48b1-ac44-06f7535beb9a" path="/var/lib/kubelet/pods/5c2c16bf-1fd4-48b1-ac44-06f7535beb9a/volumes"
Jul 27 21:32:00.454388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.454314    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.558851    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-token\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.558899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlspw\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-kube-api-access-nlspw\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.558966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-credential-socket\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.559020    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-certs\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.559055    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9d315b9-0597-480a-8961-0018c6e6c0ce-istiod-ca-cert\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.559085    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-data\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.559117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-podinfo\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.559159    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-socket\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.560311 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.559184    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-envoy\") pod \"e9d315b9-0597-480a-8961-0018c6e6c0ce\" (UID: \"e9d315b9-0597-480a-8961-0018c6e6c0ce\") "
Jul 27 21:32:00.564236 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.562230    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:32:00.565040 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.564863    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:32:00.566041 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.565785    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:32:00.567565 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.567365    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9d315b9-0597-480a-8961-0018c6e6c0ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:32:00.567748 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.567719    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:32:00.572559 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.572260    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:32:00.576253 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.576200    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-kube-api-access-nlspw" (OuterVolumeSpecName: "kube-api-access-nlspw") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "kube-api-access-nlspw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:32:00.577633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.577569    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:32:00.580625 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.580591    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e9d315b9-0597-480a-8961-0018c6e6c0ce" (UID: "e9d315b9-0597-480a-8961-0018c6e6c0ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:32:00.660848 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660816    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:00.660848 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660847    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9d315b9-0597-480a-8961-0018c6e6c0ce-istiod-ca-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:00.660848 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660856    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-data\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:00.661085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660865    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-podinfo\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:00.661085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660873    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-workload-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:00.661085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660882    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-envoy\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:00.661085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660889    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-istio-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:00.661085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660896    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlspw\" (UniqueName: \"kubernetes.io/projected/e9d315b9-0597-480a-8961-0018c6e6c0ce-kube-api-access-nlspw\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:00.661085 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:00.660904    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9d315b9-0597-480a-8961-0018c6e6c0ce-credential-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:32:01.005803 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.005762    2575 generic.go:356] "Generic (PLEG): container finished" podID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerID="f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841" exitCode=0
Jul 27 21:32:01.005975 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.005823    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"
Jul 27 21:32:01.005975 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.005846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" event={"ID":"e9d315b9-0597-480a-8961-0018c6e6c0ce","Type":"ContainerDied","Data":"f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841"}
Jul 27 21:32:01.005975 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.005903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k" event={"ID":"e9d315b9-0597-480a-8961-0018c6e6c0ce","Type":"ContainerDied","Data":"7f25ae2df0301d7b456592020b8eaed10bf7541707fd532a359e300d7854c1f2"}
Jul 27 21:32:01.005975 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.005926    2575 scope.go:117] "RemoveContainer" containerID="f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841"
Jul 27 21:32:01.015975 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.015959    2575 scope.go:117] "RemoveContainer" containerID="c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96"
Jul 27 21:32:01.023959 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.023942    2575 scope.go:117] "RemoveContainer" containerID="f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841"
Jul 27 21:32:01.024240 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:32:01.024200    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841\": container with ID starting with f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841 not found: ID does not exist" containerID="f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841"
Jul 27 21:32:01.024336 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.024248    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841"} err="failed to get container status \"f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841\": rpc error: code = NotFound desc = could not find container \"f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841\": container with ID starting with f8311a3f1102237c6dc23eee502e2e47fb122b8fc11c7197ec7f2acb30d5c841 not found: ID does not exist"
Jul 27 21:32:01.024336 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.024265    2575 scope.go:117] "RemoveContainer" containerID="c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96"
Jul 27 21:32:01.024516 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:32:01.024500    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96\": container with ID starting with c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96 not found: ID does not exist" containerID="c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96"
Jul 27 21:32:01.024557 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.024522    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96"} err="failed to get container status \"c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96\": rpc error: code = NotFound desc = could not find container \"c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96\": container with ID starting with c4cf979643273d6c5c16e5d38da2ef9a190e12dad09668dba643dbaadb979f96 not found: ID does not exist"
Jul 27 21:32:01.027981 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.027960    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"]
Jul 27 21:32:01.032601 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:01.032580    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-51e5669d-openshift-default-55cff5dd6d-tt68k"]
Jul 27 21:32:02.279161 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:32:02.279127    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" path="/var/lib/kubelet/pods/e9d315b9-0597-480a-8961-0018c6e6c0ce/volumes"
Jul 27 21:33:32.875070 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.874985    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"]
Jul 27 21:33:32.875593 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875577    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy"
Jul 27 21:33:32.875642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875596    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy"
Jul 27 21:33:32.875642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875610    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy"
Jul 27 21:33:32.875642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875619    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy"
Jul 27 21:33:32.875642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875636    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy"
Jul 27 21:33:32.875776 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875644    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy"
Jul 27 21:33:32.875776 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875661    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy"
Jul 27 21:33:32.875776 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875670    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy"
Jul 27 21:33:32.875776 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875678    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2c16bf-1fd4-48b1-ac44-06f7535beb9a" containerName="payload-processing"
Jul 27 21:33:32.875776 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875686    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2c16bf-1fd4-48b1-ac44-06f7535beb9a" containerName="payload-processing"
Jul 27 21:33:32.875924 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875778    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy"
Jul 27 21:33:32.875924 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875788    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy"
Jul 27 21:33:32.875924 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875798    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b58fcb-d1d9-40d9-953d-5a1ad35691c7" containerName="istio-proxy"
Jul 27 21:33:32.875924 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875806    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d315b9-0597-480a-8961-0018c6e6c0ce" containerName="istio-proxy"
Jul 27 21:33:32.875924 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.875815    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2c16bf-1fd4-48b1-ac44-06f7535beb9a" containerName="payload-processing"
Jul 27 21:33:32.878808 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.878790    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:32.881547 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.881495    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a3fb0814-openshift-default-dockercfg-rdhfm\""
Jul 27 21:33:32.901271 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:32.901239    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"]
Jul 27 21:33:33.030272 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-token\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.030443 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030385    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-socket\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.030443 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030431    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-envoy\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.030517 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-data\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.030517 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-credential-socket\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.030586 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-certs\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.030624 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dcrs\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-kube-api-access-8dcrs\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.030669 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c371d47-6612-434a-9c8a-8280ab0e7778-istiod-ca-cert\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.030715 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.030675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-podinfo\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.131761 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.131653    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c371d47-6612-434a-9c8a-8280ab0e7778-istiod-ca-cert\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.131761 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.131710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-podinfo\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.131761 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.131741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-token\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.132060 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.131800    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-socket\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.132060 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.131820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-envoy\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.132060 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.131839    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-data\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.132060 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.131867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-credential-socket\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.132060 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.131895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-certs\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.132704 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.132616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-data\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.133262 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.132828    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-socket\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.133262 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.132987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-certs\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.133262 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.133114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dcrs\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-kube-api-access-8dcrs\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.133262 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.133181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-credential-socket\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.133524 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.133380    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c371d47-6612-434a-9c8a-8280ab0e7778-istiod-ca-cert\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.137230 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.136000    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-envoy\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.141880 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.141849    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-token\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.144700 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.144673    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dcrs\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-kube-api-access-8dcrs\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.144829 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.144769    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-podinfo\") pod \"e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") " pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.189963 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.189923    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:33.336080 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.336039    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"]
Jul 27 21:33:33.339422 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:33:33.339396    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c371d47_6612_434a_9c8a_8280ab0e7778.slice/crio-f5f5c22527f25c1f282f1e9572b1dba13dba7b2e099667824d5f061baee1834e WatchSource:0}: Error finding container f5f5c22527f25c1f282f1e9572b1dba13dba7b2e099667824d5f061baee1834e: Status 404 returned error can't find the container with id f5f5c22527f25c1f282f1e9572b1dba13dba7b2e099667824d5f061baee1834e
Jul 27 21:33:33.341466 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.341434    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:33:33.341557 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.341503    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:33:33.341557 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.341534    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:33:33.486391 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.486351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" event={"ID":"9c371d47-6612-434a-9c8a-8280ab0e7778","Type":"ContainerStarted","Data":"860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060"}
Jul 27 21:33:33.486595 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.486427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" event={"ID":"9c371d47-6612-434a-9c8a-8280ab0e7778","Type":"ContainerStarted","Data":"f5f5c22527f25c1f282f1e9572b1dba13dba7b2e099667824d5f061baee1834e"}
Jul 27 21:33:33.507353 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:33.507289    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" podStartSLOduration=1.5072657729999999 podStartE2EDuration="1.507265773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:33:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:33:33.505337175 +0000 UTC m=+2157.771051296" watchObservedRunningTime="2026-07-27 21:33:33.507265773 +0000 UTC m=+2157.772979892"
Jul 27 21:33:34.190739 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:34.190703    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:34.195676 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:34.195653    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:34.491347 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:34.491311    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:34.492240 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:34.492190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:36.209977 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.209939    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"]
Jul 27 21:33:36.212841 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.212820    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.215139 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.215118    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a3fb0814-serving-cert\""
Jul 27 21:33:36.225147 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.225111    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"]
Jul 27 21:33:36.367112 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.367060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmqvk\" (UniqueName: \"kubernetes.io/projected/ce41a423-fddf-4af4-8f79-6c7b3e42590f-kube-api-access-gmqvk\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.367331 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.367189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.367331 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.367252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce41a423-fddf-4af4-8f79-6c7b3e42590f-openshift-service-ca\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.468937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.468835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmqvk\" (UniqueName: \"kubernetes.io/projected/ce41a423-fddf-4af4-8f79-6c7b3e42590f-kube-api-access-gmqvk\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.468937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.468900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.468937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.468927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce41a423-fddf-4af4-8f79-6c7b3e42590f-openshift-service-ca\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.469295 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:33:36.469084    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-serving-cert: secret "maas-api-e2e-mt-a3fb0814-serving-cert" not found
Jul 27 21:33:36.469295 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:33:36.469234    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls podName:ce41a423-fddf-4af4-8f79-6c7b3e42590f nodeName:}" failed. No retries permitted until 2026-07-27 21:33:36.969178181 +0000 UTC m=+2161.234892279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls") pod "maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn" (UID: "ce41a423-fddf-4af4-8f79-6c7b3e42590f") : secret "maas-api-e2e-mt-a3fb0814-serving-cert" not found
Jul 27 21:33:36.469694 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.469672    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce41a423-fddf-4af4-8f79-6c7b3e42590f-openshift-service-ca\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.477829 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.477803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmqvk\" (UniqueName: \"kubernetes.io/projected/ce41a423-fddf-4af4-8f79-6c7b3e42590f-kube-api-access-gmqvk\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.975941 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.975893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:36.978695 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:36.978668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls\") pod \"maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:37.129038 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.129002    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:37.151958 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.151919    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"]
Jul 27 21:33:37.154966 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.154950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:37.157272 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.157249    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a3fb0814-dockercfg-rmfbv\""
Jul 27 21:33:37.157408 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.157254    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a3fb0814\""
Jul 27 21:33:37.162278 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.162196    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"]
Jul 27 21:33:37.278974 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.278936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg\" (UID: \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:37.279481 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.279100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5c7k\" (UniqueName: \"kubernetes.io/projected/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-kube-api-access-q5c7k\") pod \"payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg\" (UID: \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:37.305061 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.305036    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"]
Jul 27 21:33:37.307031 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:33:37.306998    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce41a423_fddf_4af4_8f79_6c7b3e42590f.slice/crio-8a68a923e5235ecd5241e03f0818f66f7a4cc3edfa87751fc49ae790b9753b5b WatchSource:0}: Error finding container 8a68a923e5235ecd5241e03f0818f66f7a4cc3edfa87751fc49ae790b9753b5b: Status 404 returned error can't find the container with id 8a68a923e5235ecd5241e03f0818f66f7a4cc3edfa87751fc49ae790b9753b5b
Jul 27 21:33:37.380719 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.380680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5c7k\" (UniqueName: \"kubernetes.io/projected/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-kube-api-access-q5c7k\") pod \"payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg\" (UID: \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:37.380931 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.380758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg\" (UID: \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:37.381538 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.381506    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg\" (UID: \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:37.390811 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.390775    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5c7k\" (UniqueName: \"kubernetes.io/projected/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-kube-api-access-q5c7k\") pod \"payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg\" (UID: \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:37.473775 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.473733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:37.513810 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.513690    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn" event={"ID":"ce41a423-fddf-4af4-8f79-6c7b3e42590f","Type":"ContainerStarted","Data":"8a68a923e5235ecd5241e03f0818f66f7a4cc3edfa87751fc49ae790b9753b5b"}
Jul 27 21:33:37.861441 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:37.861417    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"]
Jul 27 21:33:37.864058 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:33:37.864028    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f7997bd_18ce_4234_85fa_6fffda9f5cf0.slice/crio-9e132883772465e776a52a47ecd4c17db22104af0c50b9df35e6ad60b4a37e88 WatchSource:0}: Error finding container 9e132883772465e776a52a47ecd4c17db22104af0c50b9df35e6ad60b4a37e88: Status 404 returned error can't find the container with id 9e132883772465e776a52a47ecd4c17db22104af0c50b9df35e6ad60b4a37e88
Jul 27 21:33:38.520836 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:38.520795    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn" event={"ID":"ce41a423-fddf-4af4-8f79-6c7b3e42590f","Type":"ContainerStarted","Data":"7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1"}
Jul 27 21:33:38.521436 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:38.520923    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:38.522521 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:38.522497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg" event={"ID":"4f7997bd-18ce-4234-85fa-6fffda9f5cf0","Type":"ContainerStarted","Data":"735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2"}
Jul 27 21:33:38.522654 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:38.522545    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg" event={"ID":"4f7997bd-18ce-4234-85fa-6fffda9f5cf0","Type":"ContainerStarted","Data":"9e132883772465e776a52a47ecd4c17db22104af0c50b9df35e6ad60b4a37e88"}
Jul 27 21:33:38.522654 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:38.522576    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:38.538997 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:38.538945    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn" podStartSLOduration=2.099807627 podStartE2EDuration="2.538930116s" totalImagesPullingTime="439.122489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:33:38.537752196 +0000 UTC m=+2162.803466318" watchObservedRunningTime="2026-07-27 21:33:38.538930116 +0000 UTC m=+2162.804644233"
Jul 27 21:33:38.555156 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:38.555093    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg" podStartSLOduration=1.555077659 podStartE2EDuration="1.555077659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:33:38.552559838 +0000 UTC m=+2162.818273958" watchObservedRunningTime="2026-07-27 21:33:38.555077659 +0000 UTC m=+2162.820791830"
Jul 27 21:33:44.545794 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:44.545750    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:49.492670 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.492634    2575 patch_prober.go:28] interesting pod/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:33:49.493113 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.492709    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:33:49.530904 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.530859    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:49.589749 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.589717    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerID="860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060" exitCode=0
Jul 27 21:33:49.589925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.589785    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" event={"ID":"9c371d47-6612-434a-9c8a-8280ab0e7778","Type":"ContainerDied","Data":"860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060"}
Jul 27 21:33:49.590328 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.590309    2575 scope.go:117] "RemoveContainer" containerID="860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060"
Jul 27 21:33:49.591524 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.591495    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:33:49.591596 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.591568    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:33:49.591634 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:49.591599    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:33:50.597560 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:50.597528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" event={"ID":"9c371d47-6612-434a-9c8a-8280ab0e7778","Type":"ContainerStarted","Data":"8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7"}
Jul 27 21:33:51.191123 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:51.191088    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:51.191362 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:51.191343    2575 patch_prober.go:28] interesting pod/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:33:51.191422 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:51.191403    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:33:52.190488 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:52.190459    2575 patch_prober.go:28] interesting pod/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:33:52.190894 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:52.190514    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:33:53.191107 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:53.191066    2575 patch_prober.go:28] interesting pod/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:33:53.191587 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:53.191146    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:33:54.190303 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:54.190267    2575 patch_prober.go:28] interesting pod/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 27 21:33:54.190491 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:54.190328    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 27 21:33:55.195113 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:55.195080    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:55.195520 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:55.195440    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:55.196151 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:55.196131    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:33:58.281772 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.281737    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"]
Jul 27 21:33:58.282193 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.281927    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn" podUID="ce41a423-fddf-4af4-8f79-6c7b3e42590f" containerName="maas-api" containerID="cri-o://7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1" gracePeriod=30
Jul 27 21:33:58.334374 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.334343    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"]
Jul 27 21:33:58.334649 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.334613    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg" podUID="4f7997bd-18ce-4234-85fa-6fffda9f5cf0" containerName="payload-pre-processing" containerID="cri-o://735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2" gracePeriod=30
Jul 27 21:33:58.610454 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.610429    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:58.633740 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.633708    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:58.642618 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.642595    2575 generic.go:356] "Generic (PLEG): container finished" podID="ce41a423-fddf-4af4-8f79-6c7b3e42590f" containerID="7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1" exitCode=0
Jul 27 21:33:58.642756 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.642702    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"
Jul 27 21:33:58.642756 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.642711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn" event={"ID":"ce41a423-fddf-4af4-8f79-6c7b3e42590f","Type":"ContainerDied","Data":"7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1"}
Jul 27 21:33:58.642756 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.642755    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn" event={"ID":"ce41a423-fddf-4af4-8f79-6c7b3e42590f","Type":"ContainerDied","Data":"8a68a923e5235ecd5241e03f0818f66f7a4cc3edfa87751fc49ae790b9753b5b"}
Jul 27 21:33:58.642911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.642782    2575 scope.go:117] "RemoveContainer" containerID="7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1"
Jul 27 21:33:58.644620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.644596    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f7997bd-18ce-4234-85fa-6fffda9f5cf0" containerID="735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2" exitCode=0
Jul 27 21:33:58.644743 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.644638    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"
Jul 27 21:33:58.644743 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.644687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg" event={"ID":"4f7997bd-18ce-4234-85fa-6fffda9f5cf0","Type":"ContainerDied","Data":"735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2"}
Jul 27 21:33:58.644743 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.644730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg" event={"ID":"4f7997bd-18ce-4234-85fa-6fffda9f5cf0","Type":"ContainerDied","Data":"9e132883772465e776a52a47ecd4c17db22104af0c50b9df35e6ad60b4a37e88"}
Jul 27 21:33:58.653754 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.653735    2575 scope.go:117] "RemoveContainer" containerID="7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1"
Jul 27 21:33:58.654375 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:33:58.654351    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1\": container with ID starting with 7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1 not found: ID does not exist" containerID="7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1"
Jul 27 21:33:58.654495 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.654390    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1"} err="failed to get container status \"7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1\": rpc error: code = NotFound desc = could not find container \"7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1\": container with ID starting with 7464d4d4d9bc66abe067cabb199af4351e59e1b94187e5e59f0e4ee77133a5a1 not found: ID does not exist"
Jul 27 21:33:58.654495 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.654414    2575 scope.go:117] "RemoveContainer" containerID="735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2"
Jul 27 21:33:58.664101 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.664078    2575 scope.go:117] "RemoveContainer" containerID="735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2"
Jul 27 21:33:58.664458 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:33:58.664436    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2\": container with ID starting with 735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2 not found: ID does not exist" containerID="735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2"
Jul 27 21:33:58.664530 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.664466    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2"} err="failed to get container status \"735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2\": rpc error: code = NotFound desc = could not find container \"735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2\": container with ID starting with 735e3b611b0652b3df22704ae99fde483201db67cc1428e0806d39760675f7a2 not found: ID does not exist"
Jul 27 21:33:58.697897 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.697871    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce41a423-fddf-4af4-8f79-6c7b3e42590f-openshift-service-ca\") pod \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") "
Jul 27 21:33:58.698068 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.697988    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5c7k\" (UniqueName: \"kubernetes.io/projected/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-kube-api-access-q5c7k\") pod \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\" (UID: \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\") "
Jul 27 21:33:58.698068 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.698012    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls\") pod \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") "
Jul 27 21:33:58.698068 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.698038    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-plugins-config-volume\") pod \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\" (UID: \"4f7997bd-18ce-4234-85fa-6fffda9f5cf0\") "
Jul 27 21:33:58.698241 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.698071    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmqvk\" (UniqueName: \"kubernetes.io/projected/ce41a423-fddf-4af4-8f79-6c7b3e42590f-kube-api-access-gmqvk\") pod \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\" (UID: \"ce41a423-fddf-4af4-8f79-6c7b3e42590f\") "
Jul 27 21:33:58.698241 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.698192    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce41a423-fddf-4af4-8f79-6c7b3e42590f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce41a423-fddf-4af4-8f79-6c7b3e42590f" (UID: "ce41a423-fddf-4af4-8f79-6c7b3e42590f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:33:58.698379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.698348    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce41a423-fddf-4af4-8f79-6c7b3e42590f-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:33:58.698645 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.698610    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4f7997bd-18ce-4234-85fa-6fffda9f5cf0" (UID: "4f7997bd-18ce-4234-85fa-6fffda9f5cf0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:33:58.700591 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.700565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce41a423-fddf-4af4-8f79-6c7b3e42590f-kube-api-access-gmqvk" (OuterVolumeSpecName: "kube-api-access-gmqvk") pod "ce41a423-fddf-4af4-8f79-6c7b3e42590f" (UID: "ce41a423-fddf-4af4-8f79-6c7b3e42590f"). InnerVolumeSpecName "kube-api-access-gmqvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:33:58.700591 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.700587    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-kube-api-access-q5c7k" (OuterVolumeSpecName: "kube-api-access-q5c7k") pod "4f7997bd-18ce-4234-85fa-6fffda9f5cf0" (UID: "4f7997bd-18ce-4234-85fa-6fffda9f5cf0"). InnerVolumeSpecName "kube-api-access-q5c7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:33:58.700718 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.700620    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce41a423-fddf-4af4-8f79-6c7b3e42590f" (UID: "ce41a423-fddf-4af4-8f79-6c7b3e42590f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:33:58.799581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.799501    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5c7k\" (UniqueName: \"kubernetes.io/projected/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-kube-api-access-q5c7k\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:33:58.799581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.799527    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce41a423-fddf-4af4-8f79-6c7b3e42590f-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:33:58.799581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.799536    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f7997bd-18ce-4234-85fa-6fffda9f5cf0-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:33:58.799581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.799547    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmqvk\" (UniqueName: \"kubernetes.io/projected/ce41a423-fddf-4af4-8f79-6c7b3e42590f-kube-api-access-gmqvk\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:33:58.967292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.967264    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"]
Jul 27 21:33:58.971491 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.971462    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a3fb0814-5456755dd-x4rxn"]
Jul 27 21:33:58.980245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.980222    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"]
Jul 27 21:33:58.983811 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:33:58.983781    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a3fb0814-8479cd6956-lfpmg"]
Jul 27 21:34:00.278454 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:00.278420    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f7997bd-18ce-4234-85fa-6fffda9f5cf0" path="/var/lib/kubelet/pods/4f7997bd-18ce-4234-85fa-6fffda9f5cf0/volumes"
Jul 27 21:34:00.278832 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:00.278817    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce41a423-fddf-4af4-8f79-6c7b3e42590f" path="/var/lib/kubelet/pods/ce41a423-fddf-4af4-8f79-6c7b3e42590f/volumes"
Jul 27 21:34:04.850595 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:04.850560    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"]
Jul 27 21:34:04.851114 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:04.850768    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy" containerID="cri-o://8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7" gracePeriod=30
Jul 27 21:34:10.116680 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.116613    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:34:10.213178 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213142    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dcrs\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-kube-api-access-8dcrs\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213400 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213199    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-envoy\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213400 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213244    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-socket\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213400 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213279    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-data\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213400 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213307    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-credential-socket\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213400 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213359    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-certs\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213660 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213441    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c371d47-6612-434a-9c8a-8280ab0e7778-istiod-ca-cert\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213660 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213484    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-token\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213660 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213523    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-podinfo\") pod \"9c371d47-6612-434a-9c8a-8280ab0e7778\" (UID: \"9c371d47-6612-434a-9c8a-8280ab0e7778\") "
Jul 27 21:34:10.213660 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213559    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:34:10.213660 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213594    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:34:10.213929 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213818    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:34:10.213929 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213897    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.213929 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213924    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-credential-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.214095 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.213963    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c371d47-6612-434a-9c8a-8280ab0e7778-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:34:10.214095 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.214063    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:34:10.215755 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.215730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:34:10.215868 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.215761    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:34:10.215985 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.215963    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:34:10.215985 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.215975    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-kube-api-access-8dcrs" (OuterVolumeSpecName: "kube-api-access-8dcrs") pod "9c371d47-6612-434a-9c8a-8280ab0e7778" (UID: "9c371d47-6612-434a-9c8a-8280ab0e7778"). InnerVolumeSpecName "kube-api-access-8dcrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:34:10.314404 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.314375    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-workload-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.314404 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.314401    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c371d47-6612-434a-9c8a-8280ab0e7778-istiod-ca-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.314404 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.314409    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.314605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.314416    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-podinfo\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.314605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.314425    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dcrs\" (UniqueName: \"kubernetes.io/projected/9c371d47-6612-434a-9c8a-8280ab0e7778-kube-api-access-8dcrs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.314605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.314433    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-envoy\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.314605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.314442    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c371d47-6612-434a-9c8a-8280ab0e7778-istio-data\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:34:10.709670 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.709635    2575 generic.go:356] "Generic (PLEG): container finished" podID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerID="8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7" exitCode=0
Jul 27 21:34:10.709855 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.709689    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"
Jul 27 21:34:10.709855 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.709717    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" event={"ID":"9c371d47-6612-434a-9c8a-8280ab0e7778","Type":"ContainerDied","Data":"8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7"}
Jul 27 21:34:10.709855 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.709778    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj" event={"ID":"9c371d47-6612-434a-9c8a-8280ab0e7778","Type":"ContainerDied","Data":"f5f5c22527f25c1f282f1e9572b1dba13dba7b2e099667824d5f061baee1834e"}
Jul 27 21:34:10.709855 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.709795    2575 scope.go:117] "RemoveContainer" containerID="8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7"
Jul 27 21:34:10.721132 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.721101    2575 scope.go:117] "RemoveContainer" containerID="860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060"
Jul 27 21:34:10.727138 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.727115    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"]
Jul 27 21:34:10.731026 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.730999    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a3fb0814-openshift-default-79b49c76bd-4dzcj"]
Jul 27 21:34:10.731799 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.731770    2575 scope.go:117] "RemoveContainer" containerID="8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7"
Jul 27 21:34:10.732077 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:34:10.732059    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7\": container with ID starting with 8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7 not found: ID does not exist" containerID="8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7"
Jul 27 21:34:10.732131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.732087    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7"} err="failed to get container status \"8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7\": rpc error: code = NotFound desc = could not find container \"8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7\": container with ID starting with 8abbdf716ba67a7f9748e3a237c4ec94b6a45d182ea46a9538f4c02ed236cda7 not found: ID does not exist"
Jul 27 21:34:10.732131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.732107    2575 scope.go:117] "RemoveContainer" containerID="860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060"
Jul 27 21:34:10.732398 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:34:10.732375    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060\": container with ID starting with 860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060 not found: ID does not exist" containerID="860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060"
Jul 27 21:34:10.732450 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:10.732396    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060"} err="failed to get container status \"860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060\": rpc error: code = NotFound desc = could not find container \"860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060\": container with ID starting with 860f9c5e9852aebd8625da1a2d14248ce8ac6dbe1520c09837e4abecb4e43060 not found: ID does not exist"
Jul 27 21:34:12.284148 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:12.284112    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" path="/var/lib/kubelet/pods/9c371d47-6612-434a-9c8a-8280ab0e7778/volumes"
Jul 27 21:34:24.579378 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.579341    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"]
Jul 27 21:34:24.580524 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580496    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce41a423-fddf-4af4-8f79-6c7b3e42590f" containerName="maas-api"
Jul 27 21:34:24.580524 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580523    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce41a423-fddf-4af4-8f79-6c7b3e42590f" containerName="maas-api"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580542    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580552    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580566    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580574    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580584    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f7997bd-18ce-4234-85fa-6fffda9f5cf0" containerName="payload-pre-processing"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580593    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f7997bd-18ce-4234-85fa-6fffda9f5cf0" containerName="payload-pre-processing"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580694    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce41a423-fddf-4af4-8f79-6c7b3e42590f" containerName="maas-api"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580707    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f7997bd-18ce-4234-85fa-6fffda9f5cf0" containerName="payload-pre-processing"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580717    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy"
Jul 27 21:34:24.580724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.580726    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c371d47-6612-434a-9c8a-8280ab0e7778" containerName="istio-proxy"
Jul 27 21:34:24.585554 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.585535    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.587955 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.587934    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-62de4959-openshift-default-dockercfg-qjz6n\""
Jul 27 21:34:24.596243 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.596168    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"]
Jul 27 21:34:24.744383 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-data\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.744607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgvgp\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-kube-api-access-lgvgp\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.744607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-credential-socket\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.744607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-token\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.744607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744545    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7023e75d-909e-4698-a0b7-bbc7695ea2da-istiod-ca-cert\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.744607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-podinfo\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.744867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-socket\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.744867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-certs\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.744867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.744686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-envoy\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-data\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgvgp\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-kube-api-access-lgvgp\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-credential-socket\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-token\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7023e75d-909e-4698-a0b7-bbc7695ea2da-istiod-ca-cert\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-podinfo\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-socket\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-certs\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.845945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.845803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-envoy\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.846282 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.846007    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-data\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.846282 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.846024    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-credential-socket\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.846282 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.846248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-socket\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.846432 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.846320    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-certs\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.846680 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.846549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7023e75d-909e-4698-a0b7-bbc7695ea2da-istiod-ca-cert\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.848473 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.848436    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-envoy\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.848661 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.848644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-podinfo\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.853792 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.853771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-token\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.854099 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.854074    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgvgp\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-kube-api-access-lgvgp\") pod \"e2e-mt-62de4959-openshift-default-678ccf5748-cms8h\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") " pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:24.897789 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:24.897754    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:25.043727 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:25.043695    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"]
Jul 27 21:34:25.046072 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:34:25.046045    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7023e75d_909e_4698_a0b7_bbc7695ea2da.slice/crio-805bc97316c70274db7746da1ce550e846cec199c6c97be1afedd07a5c31a47b WatchSource:0}: Error finding container 805bc97316c70274db7746da1ce550e846cec199c6c97be1afedd07a5c31a47b: Status 404 returned error can't find the container with id 805bc97316c70274db7746da1ce550e846cec199c6c97be1afedd07a5c31a47b
Jul 27 21:34:25.048297 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:25.048255    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:34:25.048381 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:25.048350    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:34:25.048420 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:25.048394    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:34:25.787731 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:25.787700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" event={"ID":"7023e75d-909e-4698-a0b7-bbc7695ea2da","Type":"ContainerStarted","Data":"9e95d6f614f2c83e183824c51ae0eaf15eed8d5d6b343d59a0d07f25aa3b9446"}
Jul 27 21:34:25.788158 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:25.787758    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" event={"ID":"7023e75d-909e-4698-a0b7-bbc7695ea2da","Type":"ContainerStarted","Data":"805bc97316c70274db7746da1ce550e846cec199c6c97be1afedd07a5c31a47b"}
Jul 27 21:34:25.806887 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:25.806830    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" podStartSLOduration=1.806809839 podStartE2EDuration="1.806809839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:25.806101811 +0000 UTC m=+2210.071815928" watchObservedRunningTime="2026-07-27 21:34:25.806809839 +0000 UTC m=+2210.072523972"
Jul 27 21:34:25.898930 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:25.898893    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:26.903422 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:26.903390    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:27.797948 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:27.797921    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:27.798833 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:27.798816    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:27.982628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:27.982598    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"]
Jul 27 21:34:27.986712 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:27.986687    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:27.989422 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:27.989388    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-62de4959-serving-cert\""
Jul 27 21:34:27.999558 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:27.999534    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"]
Jul 27 21:34:28.077190 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.077009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.077485 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.077079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smxxw\" (UniqueName: \"kubernetes.io/projected/d5565012-26b2-4ff1-be20-55bd7857a793-kube-api-access-smxxw\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.077722 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.077671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5565012-26b2-4ff1-be20-55bd7857a793-openshift-service-ca\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.179068 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.179031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smxxw\" (UniqueName: \"kubernetes.io/projected/d5565012-26b2-4ff1-be20-55bd7857a793-kube-api-access-smxxw\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.179306 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.179080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5565012-26b2-4ff1-be20-55bd7857a793-openshift-service-ca\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.179306 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.179165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.179306 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:34:28.179289    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-serving-cert: secret "maas-api-e2e-mt-62de4959-serving-cert" not found
Jul 27 21:34:28.179506 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:34:28.179363    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls podName:d5565012-26b2-4ff1-be20-55bd7857a793 nodeName:}" failed. No retries permitted until 2026-07-27 21:34:28.679340912 +0000 UTC m=+2212.945055008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls") pod "maas-api-e2e-mt-62de4959-547d4774f5-7g7k4" (UID: "d5565012-26b2-4ff1-be20-55bd7857a793") : secret "maas-api-e2e-mt-62de4959-serving-cert" not found
Jul 27 21:34:28.179875 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.179851    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5565012-26b2-4ff1-be20-55bd7857a793-openshift-service-ca\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.189328 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.189301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smxxw\" (UniqueName: \"kubernetes.io/projected/d5565012-26b2-4ff1-be20-55bd7857a793-kube-api-access-smxxw\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.637414 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.637376    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"]
Jul 27 21:34:28.641099 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.641077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:28.643153 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.643136    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-62de4959\""
Jul 27 21:34:28.648620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.648597    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"]
Jul 27 21:34:28.685886 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.685851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.688731 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.688704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls\") pod \"maas-api-e2e-mt-62de4959-547d4774f5-7g7k4\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.786594 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.786558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f\" (UID: \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:28.786778 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.786725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqdqz\" (UniqueName: \"kubernetes.io/projected/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-kube-api-access-sqdqz\") pod \"payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f\" (UID: \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:28.887963 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.887859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqdqz\" (UniqueName: \"kubernetes.io/projected/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-kube-api-access-sqdqz\") pod \"payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f\" (UID: \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:28.887963 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.887923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f\" (UID: \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:28.888713 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.888687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f\" (UID: \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:28.895341 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.895311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqdqz\" (UniqueName: \"kubernetes.io/projected/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-kube-api-access-sqdqz\") pod \"payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f\" (UID: \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:28.902344 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.902296    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:28.953739 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:28.953540    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:29.064747 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:29.064637    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"]
Jul 27 21:34:29.068080 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:34:29.068050    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5565012_26b2_4ff1_be20_55bd7857a793.slice/crio-eabdbbac035879a0b2ed2d8df91ce033401c3cf2ce495d3de303da48e8d7860a WatchSource:0}: Error finding container eabdbbac035879a0b2ed2d8df91ce033401c3cf2ce495d3de303da48e8d7860a: Status 404 returned error can't find the container with id eabdbbac035879a0b2ed2d8df91ce033401c3cf2ce495d3de303da48e8d7860a
Jul 27 21:34:29.069591 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:29.069571    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:34:29.116550 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:29.116516    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"]
Jul 27 21:34:29.117966 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:34:29.117934    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5170c4f_ba11_47e5_b7ae_d7dade8d7756.slice/crio-ccc111a245c3119522c15ee455b5ed3f4e992eaa73b8d7833429d456b8184ab9 WatchSource:0}: Error finding container ccc111a245c3119522c15ee455b5ed3f4e992eaa73b8d7833429d456b8184ab9: Status 404 returned error can't find the container with id ccc111a245c3119522c15ee455b5ed3f4e992eaa73b8d7833429d456b8184ab9
Jul 27 21:34:29.809669 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:29.809623    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4" event={"ID":"d5565012-26b2-4ff1-be20-55bd7857a793","Type":"ContainerStarted","Data":"eabdbbac035879a0b2ed2d8df91ce033401c3cf2ce495d3de303da48e8d7860a"}
Jul 27 21:34:29.811563 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:29.811533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f" event={"ID":"b5170c4f-ba11-47e5-b7ae-d7dade8d7756","Type":"ContainerStarted","Data":"bbd6c63e12557650c9dd5949624545b0a20c69efe4e3a675c0b21cb79d43e6a7"}
Jul 27 21:34:29.811724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:29.811575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f" event={"ID":"b5170c4f-ba11-47e5-b7ae-d7dade8d7756","Type":"ContainerStarted","Data":"ccc111a245c3119522c15ee455b5ed3f4e992eaa73b8d7833429d456b8184ab9"}
Jul 27 21:34:29.811795 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:29.811765    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:29.828341 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:29.828283    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f" podStartSLOduration=1.828264844 podStartE2EDuration="1.828264844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:29.826028298 +0000 UTC m=+2214.091742418" watchObservedRunningTime="2026-07-27 21:34:29.828264844 +0000 UTC m=+2214.093978964"
Jul 27 21:34:30.818165 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:30.818120    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4" event={"ID":"d5565012-26b2-4ff1-be20-55bd7857a793","Type":"ContainerStarted","Data":"f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c"}
Jul 27 21:34:30.818620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:30.818238    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:30.836543 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:30.836485    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4" podStartSLOduration=2.487562208 podStartE2EDuration="3.836468709s" totalImagesPullingTime="1.348906501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:34:30.833597137 +0000 UTC m=+2215.099311255" watchObservedRunningTime="2026-07-27 21:34:30.836468709 +0000 UTC m=+2215.102182821"
Jul 27 21:34:36.828958 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:36.828925    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:34:40.820618 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:40.820585    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:34:42.799909 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:42.799873    2575 patch_prober.go:28] interesting pod/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 27 21:34:42.800367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:42.799931    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 27 21:34:42.891550 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:42.891519    2575 generic.go:356] "Generic (PLEG): container finished" podID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerID="9e95d6f614f2c83e183824c51ae0eaf15eed8d5d6b343d59a0d07f25aa3b9446" exitCode=0
Jul 27 21:34:42.891718 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:42.891559    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" event={"ID":"7023e75d-909e-4698-a0b7-bbc7695ea2da","Type":"ContainerDied","Data":"9e95d6f614f2c83e183824c51ae0eaf15eed8d5d6b343d59a0d07f25aa3b9446"}
Jul 27 21:34:42.891982 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:42.891968    2575 scope.go:117] "RemoveContainer" containerID="9e95d6f614f2c83e183824c51ae0eaf15eed8d5d6b343d59a0d07f25aa3b9446"
Jul 27 21:34:42.892978 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:42.892952    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:34:42.893036 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:42.893023    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:34:42.893073 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:42.893053    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:34:43.899334 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:43.899301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" event={"ID":"7023e75d-909e-4698-a0b7-bbc7695ea2da","Type":"ContainerStarted","Data":"4cb513e82db689d28730206f3c1697247332c43c39412da186ba434c67ea025c"}
Jul 27 21:34:44.898037 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:44.897993    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:44.898398 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:44.898371    2575 patch_prober.go:28] interesting pod/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 27 21:34:44.898499 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:44.898474    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 27 21:34:45.898900 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:45.898860    2575 patch_prober.go:28] interesting pod/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 27 21:34:45.899346 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:45.898922    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 27 21:34:46.898874 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:46.898841    2575 patch_prober.go:28] interesting pod/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 27 21:34:46.899068 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:46.898909    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 27 21:34:47.899192 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:47.899155    2575 patch_prober.go:28] interesting pod/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 27 21:34:47.899604 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:47.899239    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 27 21:34:48.902413 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:48.902381    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:48.902838 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:48.902741    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:34:48.903391 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:34:48.903371    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:35:32.835338 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:32.835299    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"]
Jul 27 21:35:32.835918 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:32.835555    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4" podUID="d5565012-26b2-4ff1-be20-55bd7857a793" containerName="maas-api" containerID="cri-o://f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c" gracePeriod=30
Jul 27 21:35:32.884564 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:32.884529    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"]
Jul 27 21:35:32.884822 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:32.884791    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f" podUID="b5170c4f-ba11-47e5-b7ae-d7dade8d7756" containerName="payload-pre-processing" containerID="cri-o://bbd6c63e12557650c9dd5949624545b0a20c69efe4e3a675c0b21cb79d43e6a7" gracePeriod=30
Jul 27 21:35:33.156440 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.156411    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:35:33.167152 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.167126    2575 generic.go:356] "Generic (PLEG): container finished" podID="b5170c4f-ba11-47e5-b7ae-d7dade8d7756" containerID="bbd6c63e12557650c9dd5949624545b0a20c69efe4e3a675c0b21cb79d43e6a7" exitCode=0
Jul 27 21:35:33.167331 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.167198    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f" event={"ID":"b5170c4f-ba11-47e5-b7ae-d7dade8d7756","Type":"ContainerDied","Data":"bbd6c63e12557650c9dd5949624545b0a20c69efe4e3a675c0b21cb79d43e6a7"}
Jul 27 21:35:33.168747 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.168717    2575 generic.go:356] "Generic (PLEG): container finished" podID="d5565012-26b2-4ff1-be20-55bd7857a793" containerID="f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c" exitCode=0
Jul 27 21:35:33.168864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.168773    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"
Jul 27 21:35:33.168864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.168780    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4" event={"ID":"d5565012-26b2-4ff1-be20-55bd7857a793","Type":"ContainerDied","Data":"f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c"}
Jul 27 21:35:33.168864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.168831    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4" event={"ID":"d5565012-26b2-4ff1-be20-55bd7857a793","Type":"ContainerDied","Data":"eabdbbac035879a0b2ed2d8df91ce033401c3cf2ce495d3de303da48e8d7860a"}
Jul 27 21:35:33.168864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.168863    2575 scope.go:117] "RemoveContainer" containerID="f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c"
Jul 27 21:35:33.187527 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.187508    2575 scope.go:117] "RemoveContainer" containerID="f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c"
Jul 27 21:35:33.187829 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:35:33.187808    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c\": container with ID starting with f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c not found: ID does not exist" containerID="f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c"
Jul 27 21:35:33.187897 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.187842    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c"} err="failed to get container status \"f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c\": rpc error: code = NotFound desc = could not find container \"f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c\": container with ID starting with f221da677f500a14e952483316ae9b0cdde3e66866b054c565f2e9a837ddb49c not found: ID does not exist"
Jul 27 21:35:33.188796 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.188776    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:35:33.214366 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.214338    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls\") pod \"d5565012-26b2-4ff1-be20-55bd7857a793\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") "
Jul 27 21:35:33.214500 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.214425    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5565012-26b2-4ff1-be20-55bd7857a793-openshift-service-ca\") pod \"d5565012-26b2-4ff1-be20-55bd7857a793\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") "
Jul 27 21:35:33.214500 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.214471    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smxxw\" (UniqueName: \"kubernetes.io/projected/d5565012-26b2-4ff1-be20-55bd7857a793-kube-api-access-smxxw\") pod \"d5565012-26b2-4ff1-be20-55bd7857a793\" (UID: \"d5565012-26b2-4ff1-be20-55bd7857a793\") "
Jul 27 21:35:33.214783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.214755    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5565012-26b2-4ff1-be20-55bd7857a793-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5565012-26b2-4ff1-be20-55bd7857a793" (UID: "d5565012-26b2-4ff1-be20-55bd7857a793"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:33.216713 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.216689    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5565012-26b2-4ff1-be20-55bd7857a793-kube-api-access-smxxw" (OuterVolumeSpecName: "kube-api-access-smxxw") pod "d5565012-26b2-4ff1-be20-55bd7857a793" (UID: "d5565012-26b2-4ff1-be20-55bd7857a793"). InnerVolumeSpecName "kube-api-access-smxxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:35:33.216816 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.216704    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5565012-26b2-4ff1-be20-55bd7857a793" (UID: "d5565012-26b2-4ff1-be20-55bd7857a793"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:35:33.315272 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.315243    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-plugins-config-volume\") pod \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\" (UID: \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\") "
Jul 27 21:35:33.315415 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.315290    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqdqz\" (UniqueName: \"kubernetes.io/projected/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-kube-api-access-sqdqz\") pod \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\" (UID: \"b5170c4f-ba11-47e5-b7ae-d7dade8d7756\") "
Jul 27 21:35:33.315527 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.315513    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5565012-26b2-4ff1-be20-55bd7857a793-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:35:33.315568 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.315530    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smxxw\" (UniqueName: \"kubernetes.io/projected/d5565012-26b2-4ff1-be20-55bd7857a793-kube-api-access-smxxw\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:35:33.315568 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.315542    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5565012-26b2-4ff1-be20-55bd7857a793-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:35:33.315657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.315630    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5170c4f-ba11-47e5-b7ae-d7dade8d7756" (UID: "b5170c4f-ba11-47e5-b7ae-d7dade8d7756"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:35:33.317503 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.317483    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-kube-api-access-sqdqz" (OuterVolumeSpecName: "kube-api-access-sqdqz") pod "b5170c4f-ba11-47e5-b7ae-d7dade8d7756" (UID: "b5170c4f-ba11-47e5-b7ae-d7dade8d7756"). InnerVolumeSpecName "kube-api-access-sqdqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:35:33.416654 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.416567    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:35:33.416654 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.416610    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqdqz\" (UniqueName: \"kubernetes.io/projected/b5170c4f-ba11-47e5-b7ae-d7dade8d7756-kube-api-access-sqdqz\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:35:33.491499 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.491465    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"]
Jul 27 21:35:33.493358 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:33.493335    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62de4959-547d4774f5-7g7k4"]
Jul 27 21:35:34.175582 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:34.175500    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"
Jul 27 21:35:34.175582 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:34.175510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f" event={"ID":"b5170c4f-ba11-47e5-b7ae-d7dade8d7756","Type":"ContainerDied","Data":"ccc111a245c3119522c15ee455b5ed3f4e992eaa73b8d7833429d456b8184ab9"}
Jul 27 21:35:34.175582 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:34.175565    2575 scope.go:117] "RemoveContainer" containerID="bbd6c63e12557650c9dd5949624545b0a20c69efe4e3a675c0b21cb79d43e6a7"
Jul 27 21:35:34.202297 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:34.202270    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"]
Jul 27 21:35:34.204233 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:34.204196    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-62de4959-89746dd4-q6x9f"]
Jul 27 21:35:34.277749 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:34.277717    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5170c4f-ba11-47e5-b7ae-d7dade8d7756" path="/var/lib/kubelet/pods/b5170c4f-ba11-47e5-b7ae-d7dade8d7756/volumes"
Jul 27 21:35:34.278115 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:35:34.278102    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5565012-26b2-4ff1-be20-55bd7857a793" path="/var/lib/kubelet/pods/d5565012-26b2-4ff1-be20-55bd7857a793/volumes"
Jul 27 21:36:47.421825 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:47.421793    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"]
Jul 27 21:36:47.422343 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:47.422033    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy" containerID="cri-o://4cb513e82db689d28730206f3c1697247332c43c39412da186ba434c67ea025c" gracePeriod=30
Jul 27 21:36:48.905582 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:48.905548    2575 patch_prober.go:28] interesting pod/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 21:36:48.905988 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:48.905621    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:36:52.579308 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.579161    2575 generic.go:356] "Generic (PLEG): container finished" podID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerID="4cb513e82db689d28730206f3c1697247332c43c39412da186ba434c67ea025c" exitCode=0
Jul 27 21:36:52.579308 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.579241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" event={"ID":"7023e75d-909e-4698-a0b7-bbc7695ea2da","Type":"ContainerDied","Data":"4cb513e82db689d28730206f3c1697247332c43c39412da186ba434c67ea025c"}
Jul 27 21:36:52.579308 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.579310    2575 scope.go:117] "RemoveContainer" containerID="9e95d6f614f2c83e183824c51ae0eaf15eed8d5d6b343d59a0d07f25aa3b9446"
Jul 27 21:36:52.706023 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.705996    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:36:52.774014 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.773978    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-podinfo\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774028    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-token\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774092    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-credential-socket\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774158    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-envoy\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774362 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774189    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-socket\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774362 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-data\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774362 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774276    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgvgp\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-kube-api-access-lgvgp\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774362 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774300    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7023e75d-909e-4698-a0b7-bbc7695ea2da-istiod-ca-cert\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774603 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-certs\") pod \"7023e75d-909e-4698-a0b7-bbc7695ea2da\" (UID: \"7023e75d-909e-4698-a0b7-bbc7695ea2da\") "
Jul 27 21:36:52.774603 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774422    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:36:52.775043 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774777    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-credential-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:52.775043 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.774785    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7023e75d-909e-4698-a0b7-bbc7695ea2da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:36:52.775043 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.775031    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:36:52.775301 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.775151    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-data" (OuterVolumeSpecName: "istio-data") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:36:52.775448 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.775421    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:36:52.776593 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.776562    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-token" (OuterVolumeSpecName: "istio-token") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:36:52.777031 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.776956    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:36:52.777115 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.777073    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:36:52.777288 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.777266    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-kube-api-access-lgvgp" (OuterVolumeSpecName: "kube-api-access-lgvgp") pod "7023e75d-909e-4698-a0b7-bbc7695ea2da" (UID: "7023e75d-909e-4698-a0b7-bbc7695ea2da"). InnerVolumeSpecName "kube-api-access-lgvgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:36:52.875953 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.875917    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-data\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:52.875953 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.875949    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgvgp\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-kube-api-access-lgvgp\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:52.875953 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.875960    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7023e75d-909e-4698-a0b7-bbc7695ea2da-istiod-ca-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:52.876185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.875970    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:52.876185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.875978    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-podinfo\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:52.876185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.875985    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:52.876185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.875993    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-istio-envoy\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:52.876185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:52.876000    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7023e75d-909e-4698-a0b7-bbc7695ea2da-workload-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:36:53.586068 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:53.586036    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"
Jul 27 21:36:53.586532 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:53.586068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h" event={"ID":"7023e75d-909e-4698-a0b7-bbc7695ea2da","Type":"ContainerDied","Data":"805bc97316c70274db7746da1ce550e846cec199c6c97be1afedd07a5c31a47b"}
Jul 27 21:36:53.586532 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:53.586124    2575 scope.go:117] "RemoveContainer" containerID="4cb513e82db689d28730206f3c1697247332c43c39412da186ba434c67ea025c"
Jul 27 21:36:53.607187 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:53.607163    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"]
Jul 27 21:36:53.610935 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:53.610915    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-62de4959-openshift-default-678ccf5748-cms8h"]
Jul 27 21:36:54.277747 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:36:54.277701    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" path="/var/lib/kubelet/pods/7023e75d-909e-4698-a0b7-bbc7695ea2da/volumes"
Jul 27 21:37:42.633040 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.632998    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"]
Jul 27 21:37:42.633647 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633596    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5565012-26b2-4ff1-be20-55bd7857a793" containerName="maas-api"
Jul 27 21:37:42.633647 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633618    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5565012-26b2-4ff1-be20-55bd7857a793" containerName="maas-api"
Jul 27 21:37:42.633647 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633633    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5170c4f-ba11-47e5-b7ae-d7dade8d7756" containerName="payload-pre-processing"
Jul 27 21:37:42.633647 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633642    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5170c4f-ba11-47e5-b7ae-d7dade8d7756" containerName="payload-pre-processing"
Jul 27 21:37:42.633867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633664    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy"
Jul 27 21:37:42.633867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633672    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy"
Jul 27 21:37:42.633867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633695    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy"
Jul 27 21:37:42.633867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633704    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy"
Jul 27 21:37:42.633867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633812    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5565012-26b2-4ff1-be20-55bd7857a793" containerName="maas-api"
Jul 27 21:37:42.633867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633825    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy"
Jul 27 21:37:42.633867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633837    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7023e75d-909e-4698-a0b7-bbc7695ea2da" containerName="istio-proxy"
Jul 27 21:37:42.633867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.633847    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5170c4f-ba11-47e5-b7ae-d7dade8d7756" containerName="payload-pre-processing"
Jul 27 21:37:42.637081 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.637060    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.639397 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.639375    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-16c965-openshift-default-dockercfg-th7jd\""
Jul 27 21:37:42.649331 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.649307    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"]
Jul 27 21:37:42.735808 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.735776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drhmz\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-kube-api-access-drhmz\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.735990 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.735838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-socket\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.735990 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.735936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-credential-socket\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.735990 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.735980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e3635f-5d29-4e53-a37f-7e01de220736-istiod-ca-cert\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.736121 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.736017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-data\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.736121 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.736062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e3635f-5d29-4e53-a37f-7e01de220736-istio-podinfo\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.736121 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.736103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-istio-token\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.736247 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.736146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-certs\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.736247 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.736178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-envoy\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837520 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-socket\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-credential-socket\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e3635f-5d29-4e53-a37f-7e01de220736-istiod-ca-cert\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-data\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837603    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e3635f-5d29-4e53-a37f-7e01de220736-istio-podinfo\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837954 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-istio-token\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837954 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-certs\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837954 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-envoy\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837954 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837856    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-socket\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837954 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837923    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-data\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.837954 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.837938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drhmz\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-kube-api-access-drhmz\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.838286 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.838012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-credential-socket\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.838353 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.838302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-certs\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.838353 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.838323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e3635f-5d29-4e53-a37f-7e01de220736-istiod-ca-cert\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.840204 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.840180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-envoy\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.840446 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.840430    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e3635f-5d29-4e53-a37f-7e01de220736-istio-podinfo\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.846228 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.846194    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-istio-token\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.846446 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.846428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drhmz\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-kube-api-access-drhmz\") pod \"e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") " pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:42.950242 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:42.950146    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:43.094388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:43.094365    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"]
Jul 27 21:37:43.096025 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:37:43.095995    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e3635f_5d29_4e53_a37f_7e01de220736.slice/crio-18f3e89094c4444d160acf42fb0de559750a3d2ef2f751e0710d0b6fc592e1c1 WatchSource:0}: Error finding container 18f3e89094c4444d160acf42fb0de559750a3d2ef2f751e0710d0b6fc592e1c1: Status 404 returned error can't find the container with id 18f3e89094c4444d160acf42fb0de559750a3d2ef2f751e0710d0b6fc592e1c1
Jul 27 21:37:43.098097 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:43.098068    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:37:43.098151 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:43.098134    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:37:43.098188 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:43.098162    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:37:43.846144 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:43.846102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" event={"ID":"16e3635f-5d29-4e53-a37f-7e01de220736","Type":"ContainerStarted","Data":"caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b"}
Jul 27 21:37:43.846565 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:43.846172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" event={"ID":"16e3635f-5d29-4e53-a37f-7e01de220736","Type":"ContainerStarted","Data":"18f3e89094c4444d160acf42fb0de559750a3d2ef2f751e0710d0b6fc592e1c1"}
Jul 27 21:37:43.866167 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:43.866114    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" podStartSLOduration=1.866096451 podStartE2EDuration="1.866096451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:37:43.864251996 +0000 UTC m=+2408.129966119" watchObservedRunningTime="2026-07-27 21:37:43.866096451 +0000 UTC m=+2408.131810569"
Jul 27 21:37:43.951149 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:43.951117    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:44.956298 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:44.956270    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:45.856362 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:45.856324    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:45.857727 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:45.857700    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:37:46.099971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.099917    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"]
Jul 27 21:37:46.103855 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.103828    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.106682 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.106609    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-16c965-serving-cert\""
Jul 27 21:37:46.111945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.111919    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"]
Jul 27 21:37:46.170461 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.170425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.170662 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.170467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tt69\" (UniqueName: \"kubernetes.io/projected/89328783-3e83-4082-9b2e-e3761b6211e5-kube-api-access-6tt69\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.170662 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.170600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89328783-3e83-4082-9b2e-e3761b6211e5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.271379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.271342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89328783-3e83-4082-9b2e-e3761b6211e5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.271590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.271474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.271590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.271516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tt69\" (UniqueName: \"kubernetes.io/projected/89328783-3e83-4082-9b2e-e3761b6211e5-kube-api-access-6tt69\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.271714 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:37:46.271658    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-serving-cert: secret "maas-api-e2e-inf-a-16c965-serving-cert" not found
Jul 27 21:37:46.271771 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:37:46.271739    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls podName:89328783-3e83-4082-9b2e-e3761b6211e5 nodeName:}" failed. No retries permitted until 2026-07-27 21:37:46.771716146 +0000 UTC m=+2411.037430259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls") pod "maas-api-e2e-inf-a-16c965-67695d6665-rpqt9" (UID: "89328783-3e83-4082-9b2e-e3761b6211e5") : secret "maas-api-e2e-inf-a-16c965-serving-cert" not found
Jul 27 21:37:46.272128 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.272104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89328783-3e83-4082-9b2e-e3761b6211e5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.281787 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.281746    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tt69\" (UniqueName: \"kubernetes.io/projected/89328783-3e83-4082-9b2e-e3761b6211e5-kube-api-access-6tt69\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.776547 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.776507    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.776999 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.776978    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"]
Jul 27 21:37:46.779470 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.779449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls\") pod \"maas-api-e2e-inf-a-16c965-67695d6665-rpqt9\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:46.780926 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.780909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:46.783488 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.783468    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-16c965-dockercfg-zfwdd\""
Jul 27 21:37:46.783590 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.783468    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-16c965\""
Jul 27 21:37:46.789034 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.789013    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"]
Jul 27 21:37:46.877642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.877606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab924ff-7c03-414e-9c00-abde73e2db83-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb\" (UID: \"fab924ff-7c03-414e-9c00-abde73e2db83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:46.877839 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.877751    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bdl8\" (UniqueName: \"kubernetes.io/projected/fab924ff-7c03-414e-9c00-abde73e2db83-kube-api-access-5bdl8\") pod \"payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb\" (UID: \"fab924ff-7c03-414e-9c00-abde73e2db83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:46.978650 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.978609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bdl8\" (UniqueName: \"kubernetes.io/projected/fab924ff-7c03-414e-9c00-abde73e2db83-kube-api-access-5bdl8\") pod \"payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb\" (UID: \"fab924ff-7c03-414e-9c00-abde73e2db83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:46.978849 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.978714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab924ff-7c03-414e-9c00-abde73e2db83-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb\" (UID: \"fab924ff-7c03-414e-9c00-abde73e2db83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:46.979513 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.979491    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab924ff-7c03-414e-9c00-abde73e2db83-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb\" (UID: \"fab924ff-7c03-414e-9c00-abde73e2db83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:46.992001 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:46.991976    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bdl8\" (UniqueName: \"kubernetes.io/projected/fab924ff-7c03-414e-9c00-abde73e2db83-kube-api-access-5bdl8\") pod \"payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb\" (UID: \"fab924ff-7c03-414e-9c00-abde73e2db83\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:47.019466 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.019440    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:47.100061 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.100023    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:47.174143 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.174111    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"]
Jul 27 21:37:47.252834 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.252809    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"]
Jul 27 21:37:47.254901 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:37:47.254873    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab924ff_7c03_414e_9c00_abde73e2db83.slice/crio-d82d25a61ac42b5dcd58436fb7fd0a8fc0051860e49420826efdee064eadd69e WatchSource:0}: Error finding container d82d25a61ac42b5dcd58436fb7fd0a8fc0051860e49420826efdee064eadd69e: Status 404 returned error can't find the container with id d82d25a61ac42b5dcd58436fb7fd0a8fc0051860e49420826efdee064eadd69e
Jul 27 21:37:47.868196 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.868154    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9" event={"ID":"89328783-3e83-4082-9b2e-e3761b6211e5","Type":"ContainerStarted","Data":"d472979d10e68df9adec972eccc9ce45aa19943e83683708f0666057044657d3"}
Jul 27 21:37:47.868412 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.868267    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9" event={"ID":"89328783-3e83-4082-9b2e-e3761b6211e5","Type":"ContainerStarted","Data":"cb43c45496eaddf98a65c591dbfaa728cb16af95a700af6f800b6c0c6f9f58a7"}
Jul 27 21:37:47.868527 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.868507    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:47.870104 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.870081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb" event={"ID":"fab924ff-7c03-414e-9c00-abde73e2db83","Type":"ContainerStarted","Data":"7e2b830aa410fa530781a25da6b82ffed37c80cc166fe42051f256047c38a2a7"}
Jul 27 21:37:47.870263 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.870128    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb" event={"ID":"fab924ff-7c03-414e-9c00-abde73e2db83","Type":"ContainerStarted","Data":"d82d25a61ac42b5dcd58436fb7fd0a8fc0051860e49420826efdee064eadd69e"}
Jul 27 21:37:47.886461 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.886365    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9" podStartSLOduration=1.313386178 podStartE2EDuration="1.886346789s" totalImagesPullingTime="572.960611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:37:47.884863299 +0000 UTC m=+2412.150577438" watchObservedRunningTime="2026-07-27 21:37:47.886346789 +0000 UTC m=+2412.152060907"
Jul 27 21:37:47.902556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:47.902510    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb" podStartSLOduration=1.9024970030000001 podStartE2EDuration="1.902497003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:37:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:37:47.901486155 +0000 UTC m=+2412.167200274" watchObservedRunningTime="2026-07-27 21:37:47.902497003 +0000 UTC m=+2412.168211121"
Jul 27 21:37:48.875265 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:48.875230    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:53.881864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:53.881825    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:37:57.567930 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.567834    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"]
Jul 27 21:37:57.571499 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.571476    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:57.574223 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.574184    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c66b3c\""
Jul 27 21:37:57.574356 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.574286    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c66b3c-dockercfg-8smfm\""
Jul 27 21:37:57.581550 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.581526    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"]
Jul 27 21:37:57.593295 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.593264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r92kf\" (UniqueName: \"kubernetes.io/projected/f8754cff-d827-46d1-9e7d-8219af5eed62-kube-api-access-r92kf\") pod \"payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z\" (UID: \"f8754cff-d827-46d1-9e7d-8219af5eed62\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:57.593444 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.593323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8754cff-d827-46d1-9e7d-8219af5eed62-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z\" (UID: \"f8754cff-d827-46d1-9e7d-8219af5eed62\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:57.599926 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.599896    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"]
Jul 27 21:37:57.603449 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.603425    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:57.611477 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.611426    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"]
Jul 27 21:37:57.694642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.694602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r92kf\" (UniqueName: \"kubernetes.io/projected/f8754cff-d827-46d1-9e7d-8219af5eed62-kube-api-access-r92kf\") pod \"payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z\" (UID: \"f8754cff-d827-46d1-9e7d-8219af5eed62\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:57.694858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.694662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b66105-5faa-49e1-977b-2edbde4800a9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br\" (UID: \"94b66105-5faa-49e1-977b-2edbde4800a9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:57.694858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.694707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8754cff-d827-46d1-9e7d-8219af5eed62-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z\" (UID: \"f8754cff-d827-46d1-9e7d-8219af5eed62\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:57.694858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.694734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45dzn\" (UniqueName: \"kubernetes.io/projected/94b66105-5faa-49e1-977b-2edbde4800a9-kube-api-access-45dzn\") pod \"payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br\" (UID: \"94b66105-5faa-49e1-977b-2edbde4800a9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:57.695601 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.695574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8754cff-d827-46d1-9e7d-8219af5eed62-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z\" (UID: \"f8754cff-d827-46d1-9e7d-8219af5eed62\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:57.707509 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.707473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r92kf\" (UniqueName: \"kubernetes.io/projected/f8754cff-d827-46d1-9e7d-8219af5eed62-kube-api-access-r92kf\") pod \"payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z\" (UID: \"f8754cff-d827-46d1-9e7d-8219af5eed62\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:57.795653 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.795615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b66105-5faa-49e1-977b-2edbde4800a9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br\" (UID: \"94b66105-5faa-49e1-977b-2edbde4800a9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:57.795653 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.795656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45dzn\" (UniqueName: \"kubernetes.io/projected/94b66105-5faa-49e1-977b-2edbde4800a9-kube-api-access-45dzn\") pod \"payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br\" (UID: \"94b66105-5faa-49e1-977b-2edbde4800a9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:57.796349 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.796325    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b66105-5faa-49e1-977b-2edbde4800a9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br\" (UID: \"94b66105-5faa-49e1-977b-2edbde4800a9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:57.803729 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.803705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45dzn\" (UniqueName: \"kubernetes.io/projected/94b66105-5faa-49e1-977b-2edbde4800a9-kube-api-access-45dzn\") pod \"payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br\" (UID: \"94b66105-5faa-49e1-977b-2edbde4800a9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:57.883948 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.883865    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:57.916851 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:57.916794    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:58.066149 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.064665    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"]
Jul 27 21:37:58.068098 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:37:58.068053    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8754cff_d827_46d1_9e7d_8219af5eed62.slice/crio-d584cc26b01606d0fc5ff1e58b9dbc6fcad38e8fcff11bd2e80b18e28399977f WatchSource:0}: Error finding container d584cc26b01606d0fc5ff1e58b9dbc6fcad38e8fcff11bd2e80b18e28399977f: Status 404 returned error can't find the container with id d584cc26b01606d0fc5ff1e58b9dbc6fcad38e8fcff11bd2e80b18e28399977f
Jul 27 21:37:58.093816 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.093789    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"]
Jul 27 21:37:58.101478 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:37:58.101453    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b66105_5faa_49e1_977b_2edbde4800a9.slice/crio-dc624d4cd431b984d7155ca34fb156af2d22ccd9c5c9da386dd503e7c0866c1f WatchSource:0}: Error finding container dc624d4cd431b984d7155ca34fb156af2d22ccd9c5c9da386dd503e7c0866c1f: Status 404 returned error can't find the container with id dc624d4cd431b984d7155ca34fb156af2d22ccd9c5c9da386dd503e7c0866c1f
Jul 27 21:37:58.931005 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.930952    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br" event={"ID":"94b66105-5faa-49e1-977b-2edbde4800a9","Type":"ContainerStarted","Data":"d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db"}
Jul 27 21:37:58.931517 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.931201    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:37:58.931517 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.931288    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br" event={"ID":"94b66105-5faa-49e1-977b-2edbde4800a9","Type":"ContainerStarted","Data":"dc624d4cd431b984d7155ca34fb156af2d22ccd9c5c9da386dd503e7c0866c1f"}
Jul 27 21:37:58.932839 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.932812    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z" event={"ID":"f8754cff-d827-46d1-9e7d-8219af5eed62","Type":"ContainerStarted","Data":"63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0"}
Jul 27 21:37:58.932969 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.932869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z" event={"ID":"f8754cff-d827-46d1-9e7d-8219af5eed62","Type":"ContainerStarted","Data":"d584cc26b01606d0fc5ff1e58b9dbc6fcad38e8fcff11bd2e80b18e28399977f"}
Jul 27 21:37:58.932969 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.932899    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:37:58.946995 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.946941    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br" podStartSLOduration=1.946922955 podStartE2EDuration="1.946922955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:37:58.945289066 +0000 UTC m=+2423.211003187" watchObservedRunningTime="2026-07-27 21:37:58.946922955 +0000 UTC m=+2423.212637077"
Jul 27 21:37:58.959062 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:58.959016    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z" podStartSLOduration=1.959000667 podStartE2EDuration="1.959000667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:37:58.958316407 +0000 UTC m=+2423.224030526" watchObservedRunningTime="2026-07-27 21:37:58.959000667 +0000 UTC m=+2423.224714786"
Jul 27 21:37:59.882287 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:59.882259    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:37:59.941567 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:59.941537    2575 generic.go:356] "Generic (PLEG): container finished" podID="16e3635f-5d29-4e53-a37f-7e01de220736" containerID="caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b" exitCode=0
Jul 27 21:37:59.942040 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:59.941615    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" event={"ID":"16e3635f-5d29-4e53-a37f-7e01de220736","Type":"ContainerDied","Data":"caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b"}
Jul 27 21:37:59.942176 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:59.942158    2575 scope.go:117] "RemoveContainer" containerID="caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b"
Jul 27 21:37:59.943276 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:59.943244    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:37:59.943368 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:59.943324    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:37:59.943408 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:37:59.943370    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 27 21:38:00.856355 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:00.856309    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:38:00.953439 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:00.953394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" event={"ID":"16e3635f-5d29-4e53-a37f-7e01de220736","Type":"ContainerStarted","Data":"4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b"}
Jul 27 21:38:01.950888 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:01.950841    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:38:01.951911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:01.951877    2575 patch_prober.go:28] interesting pod/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 27 21:38:01.952055 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:01.951943    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 27 21:38:02.952243 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:02.952189    2575 patch_prober.go:28] interesting pod/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 27 21:38:02.952840 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:02.952807    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 27 21:38:03.951330 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:03.951282    2575 patch_prober.go:28] interesting pod/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 27 21:38:03.951561 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:03.951353    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 27 21:38:04.955347 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:04.955318    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:38:04.955810 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:04.955597    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:38:04.956297 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:04.956282    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:38:09.944129 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:09.944101    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:38:09.944585 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:09.944174    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:38:48.296301 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.296231    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"]
Jul 27 21:38:48.299747 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.299727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.303075 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.303039    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c66b3c\"/\"kube-root-ca.crt\""
Jul 27 21:38:48.303245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.303089    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c66b3c\"/\"openshift-service-ca.crt\""
Jul 27 21:38:48.303245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.303147    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c66b3c\"/\"test-model-c66b3c-kserve-self-signed-certs\""
Jul 27 21:38:48.303245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.303155    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c66b3c\"/\"default-dockercfg-clz48\""
Jul 27 21:38:48.308906 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.308884    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"]
Jul 27 21:38:48.391904 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.391869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qskl2\" (UniqueName: \"kubernetes.io/projected/67a6ecde-dd52-413a-9929-28e1486bdf3c-kube-api-access-qskl2\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.391904 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.391909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-home\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.392116 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.391947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a6ecde-dd52-413a-9929-28e1486bdf3c-tls-certs\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.392116 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.391986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-model-cache\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.392116 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.392008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-tmp-dir\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.392254 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.392123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-dshm\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.493269 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.493228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-dshm\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.493493 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.493337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskl2\" (UniqueName: \"kubernetes.io/projected/67a6ecde-dd52-413a-9929-28e1486bdf3c-kube-api-access-qskl2\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.493493 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.493371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-home\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.493493 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.493409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a6ecde-dd52-413a-9929-28e1486bdf3c-tls-certs\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.493676 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.493521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-model-cache\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.493676 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.493549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-tmp-dir\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.494021 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.493992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-tmp-dir\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.494291 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.494268    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-home\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.494468 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.494444    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-model-cache\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.496491 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.496467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-dshm\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.497153 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.497131    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a6ecde-dd52-413a-9929-28e1486bdf3c-tls-certs\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.501758 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.501729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qskl2\" (UniqueName: \"kubernetes.io/projected/67a6ecde-dd52-413a-9929-28e1486bdf3c-kube-api-access-qskl2\") pod \"test-model-c66b3c-kserve-69d449bb6c-l692q\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") " pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.610533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.610452    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:48.955581 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:48.955557    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"]
Jul 27 21:38:48.957347 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:38:48.957319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67a6ecde_dd52_413a_9929_28e1486bdf3c.slice/crio-869131732e3776c4313da32b9dcdd9a597c0f73107b0f58dcb89781951b1fd1d WatchSource:0}: Error finding container 869131732e3776c4313da32b9dcdd9a597c0f73107b0f58dcb89781951b1fd1d: Status 404 returned error can't find the container with id 869131732e3776c4313da32b9dcdd9a597c0f73107b0f58dcb89781951b1fd1d
Jul 27 21:38:49.221352 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:49.221251    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q" event={"ID":"67a6ecde-dd52-413a-9929-28e1486bdf3c","Type":"ContainerStarted","Data":"c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a"}
Jul 27 21:38:49.221352 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:49.221308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q" event={"ID":"67a6ecde-dd52-413a-9929-28e1486bdf3c","Type":"ContainerStarted","Data":"869131732e3776c4313da32b9dcdd9a597c0f73107b0f58dcb89781951b1fd1d"}
Jul 27 21:38:49.239896 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:49.239833    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q" podStartSLOduration=1.2398131430000001 podStartE2EDuration="1.239813143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:38:49.23927533 +0000 UTC m=+2473.504989445" watchObservedRunningTime="2026-07-27 21:38:49.239813143 +0000 UTC m=+2473.505527261"
Jul 27 21:38:58.611040 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:58.610994    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:58.611461 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:58.611064    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:58.623473 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:58.623441    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:38:59.284810 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:38:59.284780    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:39:32.650567 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:32.650483    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"]
Jul 27 21:39:43.193364 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.193277    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"]
Jul 27 21:39:43.193862 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.193603    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9" podUID="89328783-3e83-4082-9b2e-e3761b6211e5" containerName="maas-api" containerID="cri-o://d472979d10e68df9adec972eccc9ce45aa19943e83683708f0666057044657d3" gracePeriod=30
Jul 27 21:39:43.244675 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.244642    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"]
Jul 27 21:39:43.244960 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.244932    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb" podUID="fab924ff-7c03-414e-9c00-abde73e2db83" containerName="payload-pre-processing" containerID="cri-o://7e2b830aa410fa530781a25da6b82ffed37c80cc166fe42051f256047c38a2a7" gracePeriod=30
Jul 27 21:39:43.515194 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.515168    2575 generic.go:356] "Generic (PLEG): container finished" podID="89328783-3e83-4082-9b2e-e3761b6211e5" containerID="d472979d10e68df9adec972eccc9ce45aa19943e83683708f0666057044657d3" exitCode=0
Jul 27 21:39:43.515319 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.515247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9" event={"ID":"89328783-3e83-4082-9b2e-e3761b6211e5","Type":"ContainerDied","Data":"d472979d10e68df9adec972eccc9ce45aa19943e83683708f0666057044657d3"}
Jul 27 21:39:43.517051 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.517005    2575 generic.go:356] "Generic (PLEG): container finished" podID="fab924ff-7c03-414e-9c00-abde73e2db83" containerID="7e2b830aa410fa530781a25da6b82ffed37c80cc166fe42051f256047c38a2a7" exitCode=0
Jul 27 21:39:43.517186 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.517060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb" event={"ID":"fab924ff-7c03-414e-9c00-abde73e2db83","Type":"ContainerDied","Data":"7e2b830aa410fa530781a25da6b82ffed37c80cc166fe42051f256047c38a2a7"}
Jul 27 21:39:43.517186 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.517123    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb" event={"ID":"fab924ff-7c03-414e-9c00-abde73e2db83","Type":"ContainerDied","Data":"d82d25a61ac42b5dcd58436fb7fd0a8fc0051860e49420826efdee064eadd69e"}
Jul 27 21:39:43.517186 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.517149    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d82d25a61ac42b5dcd58436fb7fd0a8fc0051860e49420826efdee064eadd69e"
Jul 27 21:39:43.542283 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.542258    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:39:43.638074 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.638037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab924ff-7c03-414e-9c00-abde73e2db83-plugins-config-volume\") pod \"fab924ff-7c03-414e-9c00-abde73e2db83\" (UID: \"fab924ff-7c03-414e-9c00-abde73e2db83\") "
Jul 27 21:39:43.638257 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.638167    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bdl8\" (UniqueName: \"kubernetes.io/projected/fab924ff-7c03-414e-9c00-abde73e2db83-kube-api-access-5bdl8\") pod \"fab924ff-7c03-414e-9c00-abde73e2db83\" (UID: \"fab924ff-7c03-414e-9c00-abde73e2db83\") "
Jul 27 21:39:43.638456 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.638434    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fab924ff-7c03-414e-9c00-abde73e2db83-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fab924ff-7c03-414e-9c00-abde73e2db83" (UID: "fab924ff-7c03-414e-9c00-abde73e2db83"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:39:43.640466 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.640433    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fab924ff-7c03-414e-9c00-abde73e2db83-kube-api-access-5bdl8" (OuterVolumeSpecName: "kube-api-access-5bdl8") pod "fab924ff-7c03-414e-9c00-abde73e2db83" (UID: "fab924ff-7c03-414e-9c00-abde73e2db83"). InnerVolumeSpecName "kube-api-access-5bdl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:43.663409 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.663389    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:39:43.738911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.738883    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tt69\" (UniqueName: \"kubernetes.io/projected/89328783-3e83-4082-9b2e-e3761b6211e5-kube-api-access-6tt69\") pod \"89328783-3e83-4082-9b2e-e3761b6211e5\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") "
Jul 27 21:39:43.739100 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.738951    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls\") pod \"89328783-3e83-4082-9b2e-e3761b6211e5\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") "
Jul 27 21:39:43.739100 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.738998    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89328783-3e83-4082-9b2e-e3761b6211e5-openshift-service-ca\") pod \"89328783-3e83-4082-9b2e-e3761b6211e5\" (UID: \"89328783-3e83-4082-9b2e-e3761b6211e5\") "
Jul 27 21:39:43.739360 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.739343    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bdl8\" (UniqueName: \"kubernetes.io/projected/fab924ff-7c03-414e-9c00-abde73e2db83-kube-api-access-5bdl8\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:43.739443 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.739365    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab924ff-7c03-414e-9c00-abde73e2db83-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:43.739443 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.739378    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89328783-3e83-4082-9b2e-e3761b6211e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89328783-3e83-4082-9b2e-e3761b6211e5" (UID: "89328783-3e83-4082-9b2e-e3761b6211e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:39:43.741165 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.741143    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89328783-3e83-4082-9b2e-e3761b6211e5" (UID: "89328783-3e83-4082-9b2e-e3761b6211e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:39:43.741245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.741202    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89328783-3e83-4082-9b2e-e3761b6211e5-kube-api-access-6tt69" (OuterVolumeSpecName: "kube-api-access-6tt69") pod "89328783-3e83-4082-9b2e-e3761b6211e5" (UID: "89328783-3e83-4082-9b2e-e3761b6211e5"). InnerVolumeSpecName "kube-api-access-6tt69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:43.840515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.840481    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tt69\" (UniqueName: \"kubernetes.io/projected/89328783-3e83-4082-9b2e-e3761b6211e5-kube-api-access-6tt69\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:43.840515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.840509    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89328783-3e83-4082-9b2e-e3761b6211e5-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:43.840515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:43.840518    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89328783-3e83-4082-9b2e-e3761b6211e5-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:44.524125 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:44.524054    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"
Jul 27 21:39:44.524125 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:44.524067    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"
Jul 27 21:39:44.524670 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:44.524052    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9" event={"ID":"89328783-3e83-4082-9b2e-e3761b6211e5","Type":"ContainerDied","Data":"cb43c45496eaddf98a65c591dbfaa728cb16af95a700af6f800b6c0c6f9f58a7"}
Jul 27 21:39:44.524670 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:44.524185    2575 scope.go:117] "RemoveContainer" containerID="d472979d10e68df9adec972eccc9ce45aa19943e83683708f0666057044657d3"
Jul 27 21:39:44.541749 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:44.541729    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"]
Jul 27 21:39:44.545418 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:44.545396    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-16c965-69cd49c57b-kffvb"]
Jul 27 21:39:44.554838 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:44.554814    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"]
Jul 27 21:39:44.562441 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:44.562422    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-16c965-67695d6665-rpqt9"]
Jul 27 21:39:46.283525 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:46.280970    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89328783-3e83-4082-9b2e-e3761b6211e5" path="/var/lib/kubelet/pods/89328783-3e83-4082-9b2e-e3761b6211e5/volumes"
Jul 27 21:39:46.283525 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:46.281569    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fab924ff-7c03-414e-9c00-abde73e2db83" path="/var/lib/kubelet/pods/fab924ff-7c03-414e-9c00-abde73e2db83/volumes"
Jul 27 21:39:47.673335 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:47.673289    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q" podUID="67a6ecde-dd52-413a-9929-28e1486bdf3c" containerName="main" containerID="cri-o://c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a" gracePeriod=45
Jul 27 21:39:47.935888 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:47.935820    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:39:48.081328 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081298    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-model-cache\") pod \"67a6ecde-dd52-413a-9929-28e1486bdf3c\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") "
Jul 27 21:39:48.081515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081349    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-home\") pod \"67a6ecde-dd52-413a-9929-28e1486bdf3c\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") "
Jul 27 21:39:48.081515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081431    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a6ecde-dd52-413a-9929-28e1486bdf3c-tls-certs\") pod \"67a6ecde-dd52-413a-9929-28e1486bdf3c\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") "
Jul 27 21:39:48.081515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081464    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-dshm\") pod \"67a6ecde-dd52-413a-9929-28e1486bdf3c\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") "
Jul 27 21:39:48.081515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081492    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-tmp-dir\") pod \"67a6ecde-dd52-413a-9929-28e1486bdf3c\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") "
Jul 27 21:39:48.081741 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081521    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qskl2\" (UniqueName: \"kubernetes.io/projected/67a6ecde-dd52-413a-9929-28e1486bdf3c-kube-api-access-qskl2\") pod \"67a6ecde-dd52-413a-9929-28e1486bdf3c\" (UID: \"67a6ecde-dd52-413a-9929-28e1486bdf3c\") "
Jul 27 21:39:48.081741 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081593    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-model-cache" (OuterVolumeSpecName: "model-cache") pod "67a6ecde-dd52-413a-9929-28e1486bdf3c" (UID: "67a6ecde-dd52-413a-9929-28e1486bdf3c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:48.081741 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081676    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-home" (OuterVolumeSpecName: "home") pod "67a6ecde-dd52-413a-9929-28e1486bdf3c" (UID: "67a6ecde-dd52-413a-9929-28e1486bdf3c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:48.081895 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67a6ecde-dd52-413a-9929-28e1486bdf3c" (UID: "67a6ecde-dd52-413a-9929-28e1486bdf3c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:48.081895 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081858    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-home\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:48.081895 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.081872    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-model-cache\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:48.083833 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.083807    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-dshm" (OuterVolumeSpecName: "dshm") pod "67a6ecde-dd52-413a-9929-28e1486bdf3c" (UID: "67a6ecde-dd52-413a-9929-28e1486bdf3c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:48.083945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.083862    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67a6ecde-dd52-413a-9929-28e1486bdf3c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67a6ecde-dd52-413a-9929-28e1486bdf3c" (UID: "67a6ecde-dd52-413a-9929-28e1486bdf3c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:39:48.083945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.083879    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67a6ecde-dd52-413a-9929-28e1486bdf3c-kube-api-access-qskl2" (OuterVolumeSpecName: "kube-api-access-qskl2") pod "67a6ecde-dd52-413a-9929-28e1486bdf3c" (UID: "67a6ecde-dd52-413a-9929-28e1486bdf3c"). InnerVolumeSpecName "kube-api-access-qskl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:48.183317 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.183286    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-dshm\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:48.183317 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.183313    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67a6ecde-dd52-413a-9929-28e1486bdf3c-tmp-dir\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:48.183317 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.183323    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qskl2\" (UniqueName: \"kubernetes.io/projected/67a6ecde-dd52-413a-9929-28e1486bdf3c-kube-api-access-qskl2\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:48.183536 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.183334    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67a6ecde-dd52-413a-9929-28e1486bdf3c-tls-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:48.549350 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.549258    2575 generic.go:356] "Generic (PLEG): container finished" podID="67a6ecde-dd52-413a-9929-28e1486bdf3c" containerID="c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a" exitCode=0
Jul 27 21:39:48.549350 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.549309    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"
Jul 27 21:39:48.549574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.549345    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q" event={"ID":"67a6ecde-dd52-413a-9929-28e1486bdf3c","Type":"ContainerDied","Data":"c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a"}
Jul 27 21:39:48.549574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.549389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q" event={"ID":"67a6ecde-dd52-413a-9929-28e1486bdf3c","Type":"ContainerDied","Data":"869131732e3776c4313da32b9dcdd9a597c0f73107b0f58dcb89781951b1fd1d"}
Jul 27 21:39:48.549574 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.549411    2575 scope.go:117] "RemoveContainer" containerID="c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a"
Jul 27 21:39:48.558515 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.558500    2575 scope.go:117] "RemoveContainer" containerID="c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a"
Jul 27 21:39:48.558771 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:39:48.558751    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a\": container with ID starting with c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a not found: ID does not exist" containerID="c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a"
Jul 27 21:39:48.558816 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.558779    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a"} err="failed to get container status \"c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a\": rpc error: code = NotFound desc = could not find container \"c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a\": container with ID starting with c8af3654aafc5a2f6516464dff6b10c0fdf52c9ba9edb6969ea0141904a4f36a not found: ID does not exist"
Jul 27 21:39:48.563877 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.563855    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"]
Jul 27 21:39:48.567326 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:48.567306    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c66b3c/test-model-c66b3c-kserve-69d449bb6c-l692q"]
Jul 27 21:39:49.853546 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:49.853510    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"]
Jul 27 21:39:49.853985 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:49.853773    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy" containerID="cri-o://4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b" gracePeriod=30
Jul 27 21:39:49.958929 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:49.958881    2575 patch_prober.go:28] interesting pod/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 21:39:49.959115 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:49.958960    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 21:39:50.278978 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:50.278943    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67a6ecde-dd52-413a-9929-28e1486bdf3c" path="/var/lib/kubelet/pods/67a6ecde-dd52-413a-9929-28e1486bdf3c/volumes"
Jul 27 21:39:55.110700 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.110671    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:39:55.149623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149539    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-data\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.149623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149577    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-socket\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.149623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149612    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e3635f-5d29-4e53-a37f-7e01de220736-istiod-ca-cert\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.149906 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149638    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drhmz\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-kube-api-access-drhmz\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.149906 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149674    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e3635f-5d29-4e53-a37f-7e01de220736-istio-podinfo\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.149906 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149712    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-istio-token\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.149906 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149792    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-credential-socket\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.149906 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149819    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-certs\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.149906 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.149858    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-envoy\") pod \"16e3635f-5d29-4e53-a37f-7e01de220736\" (UID: \"16e3635f-5d29-4e53-a37f-7e01de220736\") "
Jul 27 21:39:55.150320 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150132    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16e3635f-5d29-4e53-a37f-7e01de220736-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:39:55.150320 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150255    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:55.150320 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150277    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:55.150491 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150347    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:55.150701 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150679    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-credential-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.150791 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150707    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.150791 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150720    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-workload-socket\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.150791 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150749    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16e3635f-5d29-4e53-a37f-7e01de220736-istiod-ca-cert\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.150791 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.150769    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-data" (OuterVolumeSpecName: "istio-data") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:55.152170 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.152141    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-kube-api-access-drhmz" (OuterVolumeSpecName: "kube-api-access-drhmz") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "kube-api-access-drhmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:55.152782 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.152760    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16e3635f-5d29-4e53-a37f-7e01de220736-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 21:39:55.153017 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.152999    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:39:55.153065 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.153014    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-istio-token" (OuterVolumeSpecName: "istio-token") pod "16e3635f-5d29-4e53-a37f-7e01de220736" (UID: "16e3635f-5d29-4e53-a37f-7e01de220736"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:39:55.251942 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.251907    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drhmz\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-kube-api-access-drhmz\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.251942 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.251937    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16e3635f-5d29-4e53-a37f-7e01de220736-istio-podinfo\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.251942 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.251951    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16e3635f-5d29-4e53-a37f-7e01de220736-istio-token\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.252185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.251963    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-envoy\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.252185 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.251976    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16e3635f-5d29-4e53-a37f-7e01de220736-istio-data\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:39:55.590435 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.590397    2575 generic.go:356] "Generic (PLEG): container finished" podID="16e3635f-5d29-4e53-a37f-7e01de220736" containerID="4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b" exitCode=0
Jul 27 21:39:55.590620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.590454    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"
Jul 27 21:39:55.590620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.590470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" event={"ID":"16e3635f-5d29-4e53-a37f-7e01de220736","Type":"ContainerDied","Data":"4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b"}
Jul 27 21:39:55.590620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.590526    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7" event={"ID":"16e3635f-5d29-4e53-a37f-7e01de220736","Type":"ContainerDied","Data":"18f3e89094c4444d160acf42fb0de559750a3d2ef2f751e0710d0b6fc592e1c1"}
Jul 27 21:39:55.590620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.590557    2575 scope.go:117] "RemoveContainer" containerID="4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b"
Jul 27 21:39:55.600112 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.600094    2575 scope.go:117] "RemoveContainer" containerID="caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b"
Jul 27 21:39:55.610387 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.610350    2575 scope.go:117] "RemoveContainer" containerID="4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b"
Jul 27 21:39:55.610859 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:39:55.610825    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b\": container with ID starting with 4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b not found: ID does not exist" containerID="4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b"
Jul 27 21:39:55.610974 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.610867    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b"} err="failed to get container status \"4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b\": rpc error: code = NotFound desc = could not find container \"4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b\": container with ID starting with 4b2fbc31021fa5f8469cc4ffa75eb2ab8784861fe63e865483fffff518c0de1b not found: ID does not exist"
Jul 27 21:39:55.610974 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.610891    2575 scope.go:117] "RemoveContainer" containerID="caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b"
Jul 27 21:39:55.611318 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:39:55.611291    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b\": container with ID starting with caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b not found: ID does not exist" containerID="caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b"
Jul 27 21:39:55.611399 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.611326    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b"} err="failed to get container status \"caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b\": rpc error: code = NotFound desc = could not find container \"caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b\": container with ID starting with caafaac1ac01c00e415206fe590b8520e2d9995ec4d41798872ab682a8e7e55b not found: ID does not exist"
Jul 27 21:39:55.613231 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.613166    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"]
Jul 27 21:39:55.615651 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:55.615629    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-16c965-openshift-default-869c75d8b6-dq9q7"]
Jul 27 21:39:56.279366 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:39:56.279333    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" path="/var/lib/kubelet/pods/16e3635f-5d29-4e53-a37f-7e01de220736/volumes"
Jul 27 21:40:00.873250 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:00.873195    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"]
Jul 27 21:40:00.873775 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:00.873504    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br" podUID="94b66105-5faa-49e1-977b-2edbde4800a9" containerName="payload-processing" containerID="cri-o://d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db" gracePeriod=30
Jul 27 21:40:00.879411 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:00.879382    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"]
Jul 27 21:40:00.879628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:00.879606    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z" podUID="f8754cff-d827-46d1-9e7d-8219af5eed62" containerName="payload-pre-processing" containerID="cri-o://63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0" gracePeriod=30
Jul 27 21:40:01.165877 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.165853    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:40:01.168964 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.168945    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:40:01.208432 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.208403    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b66105-5faa-49e1-977b-2edbde4800a9-plugins-config-volume\") pod \"94b66105-5faa-49e1-977b-2edbde4800a9\" (UID: \"94b66105-5faa-49e1-977b-2edbde4800a9\") "
Jul 27 21:40:01.208594 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.208479    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45dzn\" (UniqueName: \"kubernetes.io/projected/94b66105-5faa-49e1-977b-2edbde4800a9-kube-api-access-45dzn\") pod \"94b66105-5faa-49e1-977b-2edbde4800a9\" (UID: \"94b66105-5faa-49e1-977b-2edbde4800a9\") "
Jul 27 21:40:01.208594 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.208506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8754cff-d827-46d1-9e7d-8219af5eed62-plugins-config-volume\") pod \"f8754cff-d827-46d1-9e7d-8219af5eed62\" (UID: \"f8754cff-d827-46d1-9e7d-8219af5eed62\") "
Jul 27 21:40:01.208594 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.208590    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r92kf\" (UniqueName: \"kubernetes.io/projected/f8754cff-d827-46d1-9e7d-8219af5eed62-kube-api-access-r92kf\") pod \"f8754cff-d827-46d1-9e7d-8219af5eed62\" (UID: \"f8754cff-d827-46d1-9e7d-8219af5eed62\") "
Jul 27 21:40:01.208848 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.208823    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94b66105-5faa-49e1-977b-2edbde4800a9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94b66105-5faa-49e1-977b-2edbde4800a9" (UID: "94b66105-5faa-49e1-977b-2edbde4800a9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:40:01.208910 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.208898    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94b66105-5faa-49e1-977b-2edbde4800a9-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:01.208980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.208954    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8754cff-d827-46d1-9e7d-8219af5eed62-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8754cff-d827-46d1-9e7d-8219af5eed62" (UID: "f8754cff-d827-46d1-9e7d-8219af5eed62"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:40:01.210811 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.210787    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8754cff-d827-46d1-9e7d-8219af5eed62-kube-api-access-r92kf" (OuterVolumeSpecName: "kube-api-access-r92kf") pod "f8754cff-d827-46d1-9e7d-8219af5eed62" (UID: "f8754cff-d827-46d1-9e7d-8219af5eed62"). InnerVolumeSpecName "kube-api-access-r92kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:01.210916 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.210859    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b66105-5faa-49e1-977b-2edbde4800a9-kube-api-access-45dzn" (OuterVolumeSpecName: "kube-api-access-45dzn") pod "94b66105-5faa-49e1-977b-2edbde4800a9" (UID: "94b66105-5faa-49e1-977b-2edbde4800a9"). InnerVolumeSpecName "kube-api-access-45dzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:01.309912 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.309797    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r92kf\" (UniqueName: \"kubernetes.io/projected/f8754cff-d827-46d1-9e7d-8219af5eed62-kube-api-access-r92kf\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:01.309912 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.309831    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45dzn\" (UniqueName: \"kubernetes.io/projected/94b66105-5faa-49e1-977b-2edbde4800a9-kube-api-access-45dzn\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:01.309912 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.309848    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8754cff-d827-46d1-9e7d-8219af5eed62-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:01.624614 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.624574    2575 generic.go:356] "Generic (PLEG): container finished" podID="94b66105-5faa-49e1-977b-2edbde4800a9" containerID="d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db" exitCode=0
Jul 27 21:40:01.624614 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.624617    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"
Jul 27 21:40:01.624858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.624627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br" event={"ID":"94b66105-5faa-49e1-977b-2edbde4800a9","Type":"ContainerDied","Data":"d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db"}
Jul 27 21:40:01.624858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.624682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br" event={"ID":"94b66105-5faa-49e1-977b-2edbde4800a9","Type":"ContainerDied","Data":"dc624d4cd431b984d7155ca34fb156af2d22ccd9c5c9da386dd503e7c0866c1f"}
Jul 27 21:40:01.624858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.624709    2575 scope.go:117] "RemoveContainer" containerID="d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db"
Jul 27 21:40:01.626124 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.626100    2575 generic.go:356] "Generic (PLEG): container finished" podID="f8754cff-d827-46d1-9e7d-8219af5eed62" containerID="63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0" exitCode=0
Jul 27 21:40:01.626245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.626133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z" event={"ID":"f8754cff-d827-46d1-9e7d-8219af5eed62","Type":"ContainerDied","Data":"63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0"}
Jul 27 21:40:01.626245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.626151    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"
Jul 27 21:40:01.626245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.626171    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z" event={"ID":"f8754cff-d827-46d1-9e7d-8219af5eed62","Type":"ContainerDied","Data":"d584cc26b01606d0fc5ff1e58b9dbc6fcad38e8fcff11bd2e80b18e28399977f"}
Jul 27 21:40:01.636255 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.636232    2575 scope.go:117] "RemoveContainer" containerID="d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db"
Jul 27 21:40:01.636579 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:40:01.636530    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db\": container with ID starting with d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db not found: ID does not exist" containerID="d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db"
Jul 27 21:40:01.636670 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.636591    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db"} err="failed to get container status \"d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db\": rpc error: code = NotFound desc = could not find container \"d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db\": container with ID starting with d8dc5305711c99f7da1c9c47e5649a4975e5120f7cd7aade8aee936ac16e24db not found: ID does not exist"
Jul 27 21:40:01.636670 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.636617    2575 scope.go:117] "RemoveContainer" containerID="63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0"
Jul 27 21:40:01.645346 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.645330    2575 scope.go:117] "RemoveContainer" containerID="63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0"
Jul 27 21:40:01.645616 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:40:01.645598    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0\": container with ID starting with 63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0 not found: ID does not exist" containerID="63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0"
Jul 27 21:40:01.645664 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.645623    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0"} err="failed to get container status \"63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0\": rpc error: code = NotFound desc = could not find container \"63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0\": container with ID starting with 63f7a7bd06061b94594e18bcb970b7f920f9259d008db1b6f1d7e2d42f0742a0 not found: ID does not exist"
Jul 27 21:40:01.650549 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.650528    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"]
Jul 27 21:40:01.656038 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.656016    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c66b3c-c478b6d56-ltv6z"]
Jul 27 21:40:01.666385 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.666358    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"]
Jul 27 21:40:01.669322 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:01.669303    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c66b3c-7c9f4bf478-bp8br"]
Jul 27 21:40:02.278603 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:02.278571    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b66105-5faa-49e1-977b-2edbde4800a9" path="/var/lib/kubelet/pods/94b66105-5faa-49e1-977b-2edbde4800a9/volumes"
Jul 27 21:40:02.278983 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:02.278921    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8754cff-d827-46d1-9e7d-8219af5eed62" path="/var/lib/kubelet/pods/f8754cff-d827-46d1-9e7d-8219af5eed62/volumes"
Jul 27 21:40:11.656136 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.656099    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"]
Jul 27 21:40:11.658060 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.657669    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab924ff-7c03-414e-9c00-abde73e2db83" containerName="payload-pre-processing"
Jul 27 21:40:11.658268 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658252    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab924ff-7c03-414e-9c00-abde73e2db83" containerName="payload-pre-processing"
Jul 27 21:40:11.658381 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658370    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8754cff-d827-46d1-9e7d-8219af5eed62" containerName="payload-pre-processing"
Jul 27 21:40:11.658459 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658450    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8754cff-d827-46d1-9e7d-8219af5eed62" containerName="payload-pre-processing"
Jul 27 21:40:11.658532 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658523    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b66105-5faa-49e1-977b-2edbde4800a9" containerName="payload-processing"
Jul 27 21:40:11.658602 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658594    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b66105-5faa-49e1-977b-2edbde4800a9" containerName="payload-processing"
Jul 27 21:40:11.658682 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658673    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy"
Jul 27 21:40:11.658745 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658737    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy"
Jul 27 21:40:11.658817 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658808    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89328783-3e83-4082-9b2e-e3761b6211e5" containerName="maas-api"
Jul 27 21:40:11.658885 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658877    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="89328783-3e83-4082-9b2e-e3761b6211e5" containerName="maas-api"
Jul 27 21:40:11.658969 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.658959    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67a6ecde-dd52-413a-9929-28e1486bdf3c" containerName="main"
Jul 27 21:40:11.659032 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.659024    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="67a6ecde-dd52-413a-9929-28e1486bdf3c" containerName="main"
Jul 27 21:40:11.664030 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.664007    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8754cff-d827-46d1-9e7d-8219af5eed62" containerName="payload-pre-processing"
Jul 27 21:40:11.664174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.664064    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b66105-5faa-49e1-977b-2edbde4800a9" containerName="payload-processing"
Jul 27 21:40:11.664174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.664077    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fab924ff-7c03-414e-9c00-abde73e2db83" containerName="payload-pre-processing"
Jul 27 21:40:11.664174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.664086    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="67a6ecde-dd52-413a-9929-28e1486bdf3c" containerName="main"
Jul 27 21:40:11.664174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.664152    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy"
Jul 27 21:40:11.664174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.664173    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy"
Jul 27 21:40:11.664487 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.664190    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="89328783-3e83-4082-9b2e-e3761b6211e5" containerName="maas-api"
Jul 27 21:40:11.670691 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.670662    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"]
Jul 27 21:40:11.670818 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.670780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:11.673507 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.673485    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-aba24e-serving-cert\""
Jul 27 21:40:11.813238 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.813181    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:11.813416 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.813318    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4tdw\" (UniqueName: \"kubernetes.io/projected/fbe457f8-4341-4cfd-93e2-910e88847f97-kube-api-access-q4tdw\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:11.813416 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.813370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe457f8-4341-4cfd-93e2-910e88847f97-openshift-service-ca\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:11.914610 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.914517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4tdw\" (UniqueName: \"kubernetes.io/projected/fbe457f8-4341-4cfd-93e2-910e88847f97-kube-api-access-q4tdw\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:11.914610 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.914567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe457f8-4341-4cfd-93e2-910e88847f97-openshift-service-ca\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:11.914838 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.914644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:11.914838 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:40:11.914750    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-serving-cert: secret "maas-api-e2e-api-a-aba24e-serving-cert" not found
Jul 27 21:40:11.914838 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:40:11.914837    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls podName:fbe457f8-4341-4cfd-93e2-910e88847f97 nodeName:}" failed. No retries permitted until 2026-07-27 21:40:12.414812244 +0000 UTC m=+2556.680526340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls") pod "maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4" (UID: "fbe457f8-4341-4cfd-93e2-910e88847f97") : secret "maas-api-e2e-api-a-aba24e-serving-cert" not found
Jul 27 21:40:11.915361 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.915342    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe457f8-4341-4cfd-93e2-910e88847f97-openshift-service-ca\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:11.924859 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:11.924834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4tdw\" (UniqueName: \"kubernetes.io/projected/fbe457f8-4341-4cfd-93e2-910e88847f97-kube-api-access-q4tdw\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:12.352804 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.352773    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"]
Jul 27 21:40:12.353192 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.353180    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy"
Jul 27 21:40:12.353265 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.353195    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="16e3635f-5d29-4e53-a37f-7e01de220736" containerName="istio-proxy"
Jul 27 21:40:12.356439 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.356418    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:12.358925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.358904    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-aba24e\""
Jul 27 21:40:12.359063 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.358950    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-aba24e-dockercfg-jwj5t\""
Jul 27 21:40:12.368147 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.368124    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"]
Jul 27 21:40:12.390519 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.390482    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"]
Jul 27 21:40:12.393972 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.393950    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:12.401810 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.401746    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"]
Jul 27 21:40:12.419082 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.419053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hchns\" (UniqueName: \"kubernetes.io/projected/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-kube-api-access-hchns\") pod \"payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd\" (UID: \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:12.419234 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.419178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd\" (UID: \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:12.419288 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.419275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:12.421982 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.421952    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls\") pod \"maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:12.520423 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.520381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9881ea79-840f-4476-8748-194c3d533ead-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg\" (UID: \"9881ea79-840f-4476-8748-194c3d533ead\") " pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:12.520423 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.520430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hchns\" (UniqueName: \"kubernetes.io/projected/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-kube-api-access-hchns\") pod \"payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd\" (UID: \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:12.520632 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.520535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd\" (UID: \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:12.520632 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.520618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnxx7\" (UniqueName: \"kubernetes.io/projected/9881ea79-840f-4476-8748-194c3d533ead-kube-api-access-jnxx7\") pod \"payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg\" (UID: \"9881ea79-840f-4476-8748-194c3d533ead\") " pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:12.521263 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.521243    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd\" (UID: \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:12.530606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.530585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hchns\" (UniqueName: \"kubernetes.io/projected/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-kube-api-access-hchns\") pod \"payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd\" (UID: \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:12.582867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.582839    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:12.622203 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.622129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnxx7\" (UniqueName: \"kubernetes.io/projected/9881ea79-840f-4476-8748-194c3d533ead-kube-api-access-jnxx7\") pod \"payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg\" (UID: \"9881ea79-840f-4476-8748-194c3d533ead\") " pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:12.622388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.622198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9881ea79-840f-4476-8748-194c3d533ead-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg\" (UID: \"9881ea79-840f-4476-8748-194c3d533ead\") " pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:12.622920 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.622893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9881ea79-840f-4476-8748-194c3d533ead-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg\" (UID: \"9881ea79-840f-4476-8748-194c3d533ead\") " pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:12.631095 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.631038    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnxx7\" (UniqueName: \"kubernetes.io/projected/9881ea79-840f-4476-8748-194c3d533ead-kube-api-access-jnxx7\") pod \"payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg\" (UID: \"9881ea79-840f-4476-8748-194c3d533ead\") " pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:12.667879 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.667844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:12.707681 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.707645    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:12.734496 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.733093    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"]
Jul 27 21:40:12.745176 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:40:12.744595    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe457f8_4341_4cfd_93e2_910e88847f97.slice/crio-81a9ae580296d375097ecafb3beb8c8eb19b072b8c484417928f6c395693e48c WatchSource:0}: Error finding container 81a9ae580296d375097ecafb3beb8c8eb19b072b8c484417928f6c395693e48c: Status 404 returned error can't find the container with id 81a9ae580296d375097ecafb3beb8c8eb19b072b8c484417928f6c395693e48c
Jul 27 21:40:12.746485 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.746463    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:40:12.834826 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.834790    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"]
Jul 27 21:40:12.839626 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:40:12.839597    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d08f514_56da_4e7a_83bb_6e7ce5c208ae.slice/crio-f08b2dd619e193c3c11f79a4fe8fcd68300e0f153b26c20c046eee79804493b1 WatchSource:0}: Error finding container f08b2dd619e193c3c11f79a4fe8fcd68300e0f153b26c20c046eee79804493b1: Status 404 returned error can't find the container with id f08b2dd619e193c3c11f79a4fe8fcd68300e0f153b26c20c046eee79804493b1
Jul 27 21:40:12.879176 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:12.879150    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"]
Jul 27 21:40:12.881801 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:40:12.881777    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9881ea79_840f_4476_8748_194c3d533ead.slice/crio-05200f2f2e197cfd74047d0962734ccadb4505005765f5977ec1f63699855656 WatchSource:0}: Error finding container 05200f2f2e197cfd74047d0962734ccadb4505005765f5977ec1f63699855656: Status 404 returned error can't find the container with id 05200f2f2e197cfd74047d0962734ccadb4505005765f5977ec1f63699855656
Jul 27 21:40:13.693286 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.693252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg" event={"ID":"9881ea79-840f-4476-8748-194c3d533ead","Type":"ContainerStarted","Data":"bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9"}
Jul 27 21:40:13.693724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.693308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg" event={"ID":"9881ea79-840f-4476-8748-194c3d533ead","Type":"ContainerStarted","Data":"05200f2f2e197cfd74047d0962734ccadb4505005765f5977ec1f63699855656"}
Jul 27 21:40:13.693724 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.693353    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:13.694944 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.694913    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd" event={"ID":"6d08f514-56da-4e7a-83bb-6e7ce5c208ae","Type":"ContainerStarted","Data":"2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511"}
Jul 27 21:40:13.695074 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.694975    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:13.695074 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.695000    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd" event={"ID":"6d08f514-56da-4e7a-83bb-6e7ce5c208ae","Type":"ContainerStarted","Data":"f08b2dd619e193c3c11f79a4fe8fcd68300e0f153b26c20c046eee79804493b1"}
Jul 27 21:40:13.696440 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.696418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4" event={"ID":"fbe457f8-4341-4cfd-93e2-910e88847f97","Type":"ContainerStarted","Data":"9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f"}
Jul 27 21:40:13.696543 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.696454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4" event={"ID":"fbe457f8-4341-4cfd-93e2-910e88847f97","Type":"ContainerStarted","Data":"81a9ae580296d375097ecafb3beb8c8eb19b072b8c484417928f6c395693e48c"}
Jul 27 21:40:13.696608 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.696557    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:13.709428 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.709385    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg" podStartSLOduration=1.709371402 podStartE2EDuration="1.709371402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:13.70737969 +0000 UTC m=+2557.973093808" watchObservedRunningTime="2026-07-27 21:40:13.709371402 +0000 UTC m=+2557.975085520"
Jul 27 21:40:13.722167 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.722114    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd" podStartSLOduration=1.722100465 podStartE2EDuration="1.722100465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:13.721276857 +0000 UTC m=+2557.986990977" watchObservedRunningTime="2026-07-27 21:40:13.722100465 +0000 UTC m=+2557.987814583"
Jul 27 21:40:13.740817 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:13.740773    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4" podStartSLOduration=2.300534704 podStartE2EDuration="2.740756198s" totalImagesPullingTime="440.221494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:13.740597008 +0000 UTC m=+2558.006311131" watchObservedRunningTime="2026-07-27 21:40:13.740756198 +0000 UTC m=+2558.006470317"
Jul 27 21:40:19.706951 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.706918    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:19.754052 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.754009    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"]
Jul 27 21:40:19.758696 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.758667    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:19.760893 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.760868    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-740aee-serving-cert\""
Jul 27 21:40:19.768690 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.768397    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"]
Jul 27 21:40:19.894522 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.894483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-openshift-service-ca\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:19.894709 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.894608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-maas-api-tls\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:19.894709 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.894652    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5vhq\" (UniqueName: \"kubernetes.io/projected/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-kube-api-access-h5vhq\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:19.995438 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.995406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-maas-api-tls\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:19.995623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.995448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5vhq\" (UniqueName: \"kubernetes.io/projected/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-kube-api-access-h5vhq\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:19.995623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.995505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-openshift-service-ca\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:19.996376 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.996341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-openshift-service-ca\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:19.998263 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:19.998203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-maas-api-tls\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:20.019858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.019826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5vhq\" (UniqueName: \"kubernetes.io/projected/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-kube-api-access-h5vhq\") pod \"maas-api-e2e-api-b-740aee-db688cb99-pdd2p\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:20.073960 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.073909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:20.232980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.232952    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"]
Jul 27 21:40:20.235335 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:40:20.235300    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b970bf_c1b8_4e5d_adac_2e81b1ae0832.slice/crio-c2232b50e38115b98ead60d9210b43d8361176eb5d4229ee40b62ce57e772f22 WatchSource:0}: Error finding container c2232b50e38115b98ead60d9210b43d8361176eb5d4229ee40b62ce57e772f22: Status 404 returned error can't find the container with id c2232b50e38115b98ead60d9210b43d8361176eb5d4229ee40b62ce57e772f22
Jul 27 21:40:20.577349 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.577323    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"]
Jul 27 21:40:20.582251 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.582232    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:20.584644 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.584608    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-740aee\""
Jul 27 21:40:20.584841 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.584828    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-740aee-dockercfg-jkrd9\""
Jul 27 21:40:20.593347 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.593326    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"]
Jul 27 21:40:20.610306 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.610285    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"]
Jul 27 21:40:20.613763 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.613747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:20.620993 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.620969    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"]
Jul 27 21:40:20.703857 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.703827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrlqr\" (UniqueName: \"kubernetes.io/projected/2da24537-8522-4d3d-ba2d-b56a9293e1e9-kube-api-access-xrlqr\") pod \"payload-processing-e2e-api-b-740aee-6997d76b86-whbgd\" (UID: \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\") " pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:20.704032 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.703868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp\" (UID: \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:20.704032 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.704002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-262sb\" (UniqueName: \"kubernetes.io/projected/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-kube-api-access-262sb\") pod \"payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp\" (UID: \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:20.704112 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.704081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2da24537-8522-4d3d-ba2d-b56a9293e1e9-plugins-config-volume\") pod \"payload-processing-e2e-api-b-740aee-6997d76b86-whbgd\" (UID: \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\") " pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:20.736441 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.736399    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p" event={"ID":"15b970bf-c1b8-4e5d-adac-2e81b1ae0832","Type":"ContainerStarted","Data":"2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84"}
Jul 27 21:40:20.744627 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.744592    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p" event={"ID":"15b970bf-c1b8-4e5d-adac-2e81b1ae0832","Type":"ContainerStarted","Data":"c2232b50e38115b98ead60d9210b43d8361176eb5d4229ee40b62ce57e772f22"}
Jul 27 21:40:20.744783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.744767    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:20.755594 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.755547    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p" podStartSLOduration=1.440115337 podStartE2EDuration="1.755532005s" totalImagesPullingTime="315.416668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:20.752303085 +0000 UTC m=+2565.018017253" watchObservedRunningTime="2026-07-27 21:40:20.755532005 +0000 UTC m=+2565.021246122"
Jul 27 21:40:20.805458 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.805362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-262sb\" (UniqueName: \"kubernetes.io/projected/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-kube-api-access-262sb\") pod \"payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp\" (UID: \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:20.805458 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.805431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2da24537-8522-4d3d-ba2d-b56a9293e1e9-plugins-config-volume\") pod \"payload-processing-e2e-api-b-740aee-6997d76b86-whbgd\" (UID: \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\") " pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:20.805677 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.805513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrlqr\" (UniqueName: \"kubernetes.io/projected/2da24537-8522-4d3d-ba2d-b56a9293e1e9-kube-api-access-xrlqr\") pod \"payload-processing-e2e-api-b-740aee-6997d76b86-whbgd\" (UID: \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\") " pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:20.805677 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.805548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp\" (UID: \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:20.806341 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.806309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2da24537-8522-4d3d-ba2d-b56a9293e1e9-plugins-config-volume\") pod \"payload-processing-e2e-api-b-740aee-6997d76b86-whbgd\" (UID: \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\") " pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:20.806551 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.806532    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp\" (UID: \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:20.813329 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.813308    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-262sb\" (UniqueName: \"kubernetes.io/projected/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-kube-api-access-262sb\") pod \"payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp\" (UID: \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:20.813329 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.813320    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrlqr\" (UniqueName: \"kubernetes.io/projected/2da24537-8522-4d3d-ba2d-b56a9293e1e9-kube-api-access-xrlqr\") pod \"payload-processing-e2e-api-b-740aee-6997d76b86-whbgd\" (UID: \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\") " pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:20.896819 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.896768    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:20.925460 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:20.925430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:21.055011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.054981    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"]
Jul 27 21:40:21.058793 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:40:21.058748    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0483ba_5eff_4dcf_9d6e_0818bcb5f3a2.slice/crio-0fde6966a8ddbb5ef7c618a43a2ded630c21571b191f87d08dc1c634259b0df1 WatchSource:0}: Error finding container 0fde6966a8ddbb5ef7c618a43a2ded630c21571b191f87d08dc1c634259b0df1: Status 404 returned error can't find the container with id 0fde6966a8ddbb5ef7c618a43a2ded630c21571b191f87d08dc1c634259b0df1
Jul 27 21:40:21.091886 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.091861    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"]
Jul 27 21:40:21.103461 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:40:21.103428    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da24537_8522_4d3d_ba2d_b56a9293e1e9.slice/crio-cb562eaf5347f6f0cc3db60c81489b112143da4764c45b2fe10163beb453b984 WatchSource:0}: Error finding container cb562eaf5347f6f0cc3db60c81489b112143da4764c45b2fe10163beb453b984: Status 404 returned error can't find the container with id cb562eaf5347f6f0cc3db60c81489b112143da4764c45b2fe10163beb453b984
Jul 27 21:40:21.747766 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.747728    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp" event={"ID":"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2","Type":"ContainerStarted","Data":"e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0"}
Jul 27 21:40:21.748275 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.747786    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp" event={"ID":"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2","Type":"ContainerStarted","Data":"0fde6966a8ddbb5ef7c618a43a2ded630c21571b191f87d08dc1c634259b0df1"}
Jul 27 21:40:21.748275 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.747812    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:21.749691 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.749664    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd" event={"ID":"2da24537-8522-4d3d-ba2d-b56a9293e1e9","Type":"ContainerStarted","Data":"f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515"}
Jul 27 21:40:21.749820 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.749711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd" event={"ID":"2da24537-8522-4d3d-ba2d-b56a9293e1e9","Type":"ContainerStarted","Data":"cb562eaf5347f6f0cc3db60c81489b112143da4764c45b2fe10163beb453b984"}
Jul 27 21:40:21.749820 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.749805    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:21.768784 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.768735    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp" podStartSLOduration=1.768720524 podStartE2EDuration="1.768720524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:21.766513312 +0000 UTC m=+2566.032227434" watchObservedRunningTime="2026-07-27 21:40:21.768720524 +0000 UTC m=+2566.034434641"
Jul 27 21:40:21.783431 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:21.783386    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd" podStartSLOduration=1.783370903 podStartE2EDuration="1.783370903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:21.782773918 +0000 UTC m=+2566.048488038" watchObservedRunningTime="2026-07-27 21:40:21.783370903 +0000 UTC m=+2566.049085021"
Jul 27 21:40:24.704104 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:24.704073    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:24.704611 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:24.704145    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:27.762424 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:27.762391    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:40:32.758429 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:32.758397    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:40:32.758861 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:32.758592    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:40:48.274674 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.274626    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"]
Jul 27 21:40:48.275163 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.274966    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4" podUID="fbe457f8-4341-4cfd-93e2-910e88847f97" containerName="maas-api" containerID="cri-o://9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f" gracePeriod=30
Jul 27 21:40:48.335025 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.334990    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"]
Jul 27 21:40:48.335342 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.335284    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg" podUID="9881ea79-840f-4476-8748-194c3d533ead" containerName="payload-processing" containerID="cri-o://bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9" gracePeriod=30
Jul 27 21:40:48.342087 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.342059    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"]
Jul 27 21:40:48.342403 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.342344    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd" podUID="6d08f514-56da-4e7a-83bb-6e7ce5c208ae" containerName="payload-pre-processing" containerID="cri-o://2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511" gracePeriod=30
Jul 27 21:40:48.632061 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.631982    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:48.640207 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.640178    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:48.652414 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.652393    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:48.671242 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.671182    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls\") pod \"fbe457f8-4341-4cfd-93e2-910e88847f97\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") "
Jul 27 21:40:48.671396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.671272    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4tdw\" (UniqueName: \"kubernetes.io/projected/fbe457f8-4341-4cfd-93e2-910e88847f97-kube-api-access-q4tdw\") pod \"fbe457f8-4341-4cfd-93e2-910e88847f97\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") "
Jul 27 21:40:48.671396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.671326    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe457f8-4341-4cfd-93e2-910e88847f97-openshift-service-ca\") pod \"fbe457f8-4341-4cfd-93e2-910e88847f97\" (UID: \"fbe457f8-4341-4cfd-93e2-910e88847f97\") "
Jul 27 21:40:48.671396 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.671357    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnxx7\" (UniqueName: \"kubernetes.io/projected/9881ea79-840f-4476-8748-194c3d533ead-kube-api-access-jnxx7\") pod \"9881ea79-840f-4476-8748-194c3d533ead\" (UID: \"9881ea79-840f-4476-8748-194c3d533ead\") "
Jul 27 21:40:48.671568 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.671404    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9881ea79-840f-4476-8748-194c3d533ead-plugins-config-volume\") pod \"9881ea79-840f-4476-8748-194c3d533ead\" (UID: \"9881ea79-840f-4476-8748-194c3d533ead\") "
Jul 27 21:40:48.671773 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.671742    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe457f8-4341-4cfd-93e2-910e88847f97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbe457f8-4341-4cfd-93e2-910e88847f97" (UID: "fbe457f8-4341-4cfd-93e2-910e88847f97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:40:48.671896 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.671809    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9881ea79-840f-4476-8748-194c3d533ead-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9881ea79-840f-4476-8748-194c3d533ead" (UID: "9881ea79-840f-4476-8748-194c3d533ead"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:40:48.673657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.673627    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9881ea79-840f-4476-8748-194c3d533ead-kube-api-access-jnxx7" (OuterVolumeSpecName: "kube-api-access-jnxx7") pod "9881ea79-840f-4476-8748-194c3d533ead" (UID: "9881ea79-840f-4476-8748-194c3d533ead"). InnerVolumeSpecName "kube-api-access-jnxx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:48.673951 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.673931    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbe457f8-4341-4cfd-93e2-910e88847f97" (UID: "fbe457f8-4341-4cfd-93e2-910e88847f97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:40:48.674004 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.673985    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe457f8-4341-4cfd-93e2-910e88847f97-kube-api-access-q4tdw" (OuterVolumeSpecName: "kube-api-access-q4tdw") pod "fbe457f8-4341-4cfd-93e2-910e88847f97" (UID: "fbe457f8-4341-4cfd-93e2-910e88847f97"). InnerVolumeSpecName "kube-api-access-q4tdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:48.772278 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.772243    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hchns\" (UniqueName: \"kubernetes.io/projected/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-kube-api-access-hchns\") pod \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\" (UID: \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\") "
Jul 27 21:40:48.772475 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.772391    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-plugins-config-volume\") pod \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\" (UID: \"6d08f514-56da-4e7a-83bb-6e7ce5c208ae\") "
Jul 27 21:40:48.772605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.772586    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9881ea79-840f-4476-8748-194c3d533ead-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:48.772605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.772606    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe457f8-4341-4cfd-93e2-910e88847f97-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:48.772769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.772622    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4tdw\" (UniqueName: \"kubernetes.io/projected/fbe457f8-4341-4cfd-93e2-910e88847f97-kube-api-access-q4tdw\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:48.772769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.772636    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe457f8-4341-4cfd-93e2-910e88847f97-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:48.772769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.772650    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnxx7\" (UniqueName: \"kubernetes.io/projected/9881ea79-840f-4476-8748-194c3d533ead-kube-api-access-jnxx7\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:48.772769 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.772675    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d08f514-56da-4e7a-83bb-6e7ce5c208ae" (UID: "6d08f514-56da-4e7a-83bb-6e7ce5c208ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:40:48.774566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.774544    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-kube-api-access-hchns" (OuterVolumeSpecName: "kube-api-access-hchns") pod "6d08f514-56da-4e7a-83bb-6e7ce5c208ae" (UID: "6d08f514-56da-4e7a-83bb-6e7ce5c208ae"). InnerVolumeSpecName "kube-api-access-hchns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:40:48.873619 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.873535    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:48.873619 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.873585    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hchns\" (UniqueName: \"kubernetes.io/projected/6d08f514-56da-4e7a-83bb-6e7ce5c208ae-kube-api-access-hchns\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:40:48.901385 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.901351    2575 generic.go:356] "Generic (PLEG): container finished" podID="fbe457f8-4341-4cfd-93e2-910e88847f97" containerID="9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f" exitCode=0
Jul 27 21:40:48.901556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.901397    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"
Jul 27 21:40:48.901556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.901418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4" event={"ID":"fbe457f8-4341-4cfd-93e2-910e88847f97","Type":"ContainerDied","Data":"9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f"}
Jul 27 21:40:48.901556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.901469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4" event={"ID":"fbe457f8-4341-4cfd-93e2-910e88847f97","Type":"ContainerDied","Data":"81a9ae580296d375097ecafb3beb8c8eb19b072b8c484417928f6c395693e48c"}
Jul 27 21:40:48.901556 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.901491    2575 scope.go:117] "RemoveContainer" containerID="9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f"
Jul 27 21:40:48.902835 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.902816    2575 generic.go:356] "Generic (PLEG): container finished" podID="9881ea79-840f-4476-8748-194c3d533ead" containerID="bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9" exitCode=0
Jul 27 21:40:48.902925 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.902901    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg" event={"ID":"9881ea79-840f-4476-8748-194c3d533ead","Type":"ContainerDied","Data":"bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9"}
Jul 27 21:40:48.902980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.902909    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"
Jul 27 21:40:48.902980 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.902937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg" event={"ID":"9881ea79-840f-4476-8748-194c3d533ead","Type":"ContainerDied","Data":"05200f2f2e197cfd74047d0962734ccadb4505005765f5977ec1f63699855656"}
Jul 27 21:40:48.904495 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.904467    2575 generic.go:356] "Generic (PLEG): container finished" podID="6d08f514-56da-4e7a-83bb-6e7ce5c208ae" containerID="2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511" exitCode=0
Jul 27 21:40:48.904638 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.904503    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd" event={"ID":"6d08f514-56da-4e7a-83bb-6e7ce5c208ae","Type":"ContainerDied","Data":"2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511"}
Jul 27 21:40:48.904638 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.904523    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"
Jul 27 21:40:48.904638 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.904544    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd" event={"ID":"6d08f514-56da-4e7a-83bb-6e7ce5c208ae","Type":"ContainerDied","Data":"f08b2dd619e193c3c11f79a4fe8fcd68300e0f153b26c20c046eee79804493b1"}
Jul 27 21:40:48.912605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.912587    2575 scope.go:117] "RemoveContainer" containerID="9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f"
Jul 27 21:40:48.912870 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:40:48.912853    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f\": container with ID starting with 9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f not found: ID does not exist" containerID="9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f"
Jul 27 21:40:48.912934 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.912877    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f"} err="failed to get container status \"9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f\": rpc error: code = NotFound desc = could not find container \"9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f\": container with ID starting with 9e4e6c3b579e556f519adcf5824a296078a913979f3753300eedddf0bafec11f not found: ID does not exist"
Jul 27 21:40:48.912934 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.912893    2575 scope.go:117] "RemoveContainer" containerID="bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9"
Jul 27 21:40:48.921263 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.921250    2575 scope.go:117] "RemoveContainer" containerID="bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9"
Jul 27 21:40:48.921492 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:40:48.921477    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9\": container with ID starting with bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9 not found: ID does not exist" containerID="bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9"
Jul 27 21:40:48.921539 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.921499    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9"} err="failed to get container status \"bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9\": rpc error: code = NotFound desc = could not find container \"bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9\": container with ID starting with bec81baf5cf07b73bd89d982674a2f69bb222f00721bcb9565fa67f423eb34a9 not found: ID does not exist"
Jul 27 21:40:48.921539 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.921515    2575 scope.go:117] "RemoveContainer" containerID="2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511"
Jul 27 21:40:48.929659 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.929630    2575 scope.go:117] "RemoveContainer" containerID="2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511"
Jul 27 21:40:48.929959 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:40:48.929936    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511\": container with ID starting with 2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511 not found: ID does not exist" containerID="2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511"
Jul 27 21:40:48.930032 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.929969    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511"} err="failed to get container status \"2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511\": rpc error: code = NotFound desc = could not find container \"2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511\": container with ID starting with 2946eaa7d7d90a0c22a3a0372e83d7d92b22b8226491805dab1137bf2a6c6511 not found: ID does not exist"
Jul 27 21:40:48.930886 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.930869    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"]
Jul 27 21:40:48.934923 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.934905    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-aba24e-5bc94674b9-cc8b4"]
Jul 27 21:40:48.944609 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.944589    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"]
Jul 27 21:40:48.947310 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.947290    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aba24e-696d8d594-qt5rg"]
Jul 27 21:40:48.958201 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.958182    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"]
Jul 27 21:40:48.961493 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:48.961472    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aba24e-6b66598d84-wlnpd"]
Jul 27 21:40:50.278168 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:50.278137    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d08f514-56da-4e7a-83bb-6e7ce5c208ae" path="/var/lib/kubelet/pods/6d08f514-56da-4e7a-83bb-6e7ce5c208ae/volumes"
Jul 27 21:40:50.278569 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:50.278526    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9881ea79-840f-4476-8748-194c3d533ead" path="/var/lib/kubelet/pods/9881ea79-840f-4476-8748-194c3d533ead/volumes"
Jul 27 21:40:50.278857 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:40:50.278844    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe457f8-4341-4cfd-93e2-910e88847f97" path="/var/lib/kubelet/pods/fbe457f8-4341-4cfd-93e2-910e88847f97/volumes"
Jul 27 21:41:11.118973 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.118872    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"]
Jul 27 21:41:11.119466 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.119107    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p" podUID="15b970bf-c1b8-4e5d-adac-2e81b1ae0832" containerName="maas-api" containerID="cri-o://2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84" gracePeriod=30
Jul 27 21:41:11.177106 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.177072    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"]
Jul 27 21:41:11.177389 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.177353    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd" podUID="2da24537-8522-4d3d-ba2d-b56a9293e1e9" containerName="payload-processing" containerID="cri-o://f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515" gracePeriod=30
Jul 27 21:41:11.190981 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.185984    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"]
Jul 27 21:41:11.190981 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.187755    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp" podUID="cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2" containerName="payload-pre-processing" containerID="cri-o://e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0" gracePeriod=30
Jul 27 21:41:11.499032 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.499010    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:41:11.513416 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.513392    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:41:11.516429 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.516414    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:41:11.588459 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.588420    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrlqr\" (UniqueName: \"kubernetes.io/projected/2da24537-8522-4d3d-ba2d-b56a9293e1e9-kube-api-access-xrlqr\") pod \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\" (UID: \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\") "
Jul 27 21:41:11.588628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.588536    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2da24537-8522-4d3d-ba2d-b56a9293e1e9-plugins-config-volume\") pod \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\" (UID: \"2da24537-8522-4d3d-ba2d-b56a9293e1e9\") "
Jul 27 21:41:11.588875 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.588852    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da24537-8522-4d3d-ba2d-b56a9293e1e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2da24537-8522-4d3d-ba2d-b56a9293e1e9" (UID: "2da24537-8522-4d3d-ba2d-b56a9293e1e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:41:11.590741 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.590719    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da24537-8522-4d3d-ba2d-b56a9293e1e9-kube-api-access-xrlqr" (OuterVolumeSpecName: "kube-api-access-xrlqr") pod "2da24537-8522-4d3d-ba2d-b56a9293e1e9" (UID: "2da24537-8522-4d3d-ba2d-b56a9293e1e9"). InnerVolumeSpecName "kube-api-access-xrlqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:11.689432 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689353    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-262sb\" (UniqueName: \"kubernetes.io/projected/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-kube-api-access-262sb\") pod \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\" (UID: \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\") "
Jul 27 21:41:11.689432 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-openshift-service-ca\") pod \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") "
Jul 27 21:41:11.689664 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-plugins-config-volume\") pod \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\" (UID: \"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2\") "
Jul 27 21:41:11.689664 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689470    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-maas-api-tls\") pod \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") "
Jul 27 21:41:11.689664 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689510    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5vhq\" (UniqueName: \"kubernetes.io/projected/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-kube-api-access-h5vhq\") pod \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\" (UID: \"15b970bf-c1b8-4e5d-adac-2e81b1ae0832\") "
Jul 27 21:41:11.689903 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689770    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2da24537-8522-4d3d-ba2d-b56a9293e1e9-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:41:11.689903 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689789    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrlqr\" (UniqueName: \"kubernetes.io/projected/2da24537-8522-4d3d-ba2d-b56a9293e1e9-kube-api-access-xrlqr\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:41:11.689903 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689843    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15b970bf-c1b8-4e5d-adac-2e81b1ae0832" (UID: "15b970bf-c1b8-4e5d-adac-2e81b1ae0832"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:41:11.689903 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.689862    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2" (UID: "cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:41:11.691813 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.691785    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-kube-api-access-262sb" (OuterVolumeSpecName: "kube-api-access-262sb") pod "cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2" (UID: "cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2"). InnerVolumeSpecName "kube-api-access-262sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:11.691929 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.691859    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15b970bf-c1b8-4e5d-adac-2e81b1ae0832" (UID: "15b970bf-c1b8-4e5d-adac-2e81b1ae0832"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:41:11.691990 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.691944    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-kube-api-access-h5vhq" (OuterVolumeSpecName: "kube-api-access-h5vhq") pod "15b970bf-c1b8-4e5d-adac-2e81b1ae0832" (UID: "15b970bf-c1b8-4e5d-adac-2e81b1ae0832"). InnerVolumeSpecName "kube-api-access-h5vhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:41:11.790888 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.790853    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:41:11.790888 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.790885    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:41:11.791095 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.790900    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:41:11.791095 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.790913    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5vhq\" (UniqueName: \"kubernetes.io/projected/15b970bf-c1b8-4e5d-adac-2e81b1ae0832-kube-api-access-h5vhq\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:41:11.791095 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:11.790925    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-262sb\" (UniqueName: \"kubernetes.io/projected/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2-kube-api-access-262sb\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:41:12.037554 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.037518    2575 generic.go:356] "Generic (PLEG): container finished" podID="15b970bf-c1b8-4e5d-adac-2e81b1ae0832" containerID="2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84" exitCode=0
Jul 27 21:41:12.037746 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.037569    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"
Jul 27 21:41:12.037746 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.037596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p" event={"ID":"15b970bf-c1b8-4e5d-adac-2e81b1ae0832","Type":"ContainerDied","Data":"2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84"}
Jul 27 21:41:12.037746 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.037655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p" event={"ID":"15b970bf-c1b8-4e5d-adac-2e81b1ae0832","Type":"ContainerDied","Data":"c2232b50e38115b98ead60d9210b43d8361176eb5d4229ee40b62ce57e772f22"}
Jul 27 21:41:12.037746 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.037685    2575 scope.go:117] "RemoveContainer" containerID="2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84"
Jul 27 21:41:12.038899 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.038876    2575 generic.go:356] "Generic (PLEG): container finished" podID="cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2" containerID="e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0" exitCode=0
Jul 27 21:41:12.039003 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.038930    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"
Jul 27 21:41:12.039003 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.038965    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp" event={"ID":"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2","Type":"ContainerDied","Data":"e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0"}
Jul 27 21:41:12.039195 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.039012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp" event={"ID":"cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2","Type":"ContainerDied","Data":"0fde6966a8ddbb5ef7c618a43a2ded630c21571b191f87d08dc1c634259b0df1"}
Jul 27 21:41:12.041265 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.041243    2575 generic.go:356] "Generic (PLEG): container finished" podID="2da24537-8522-4d3d-ba2d-b56a9293e1e9" containerID="f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515" exitCode=0
Jul 27 21:41:12.041387 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.041304    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"
Jul 27 21:41:12.041387 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.041313    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd" event={"ID":"2da24537-8522-4d3d-ba2d-b56a9293e1e9","Type":"ContainerDied","Data":"f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515"}
Jul 27 21:41:12.041387 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.041346    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd" event={"ID":"2da24537-8522-4d3d-ba2d-b56a9293e1e9","Type":"ContainerDied","Data":"cb562eaf5347f6f0cc3db60c81489b112143da4764c45b2fe10163beb453b984"}
Jul 27 21:41:12.048606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.048506    2575 scope.go:117] "RemoveContainer" containerID="2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84"
Jul 27 21:41:12.048885 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:41:12.048851    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84\": container with ID starting with 2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84 not found: ID does not exist" containerID="2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84"
Jul 27 21:41:12.049008 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.048895    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84"} err="failed to get container status \"2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84\": rpc error: code = NotFound desc = could not find container \"2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84\": container with ID starting with 2668fccd0ebdc6aa1ed88cff4f0c6b9fe3c9e5457ab33b65210c8c5a30aeee84 not found: ID does not exist"
Jul 27 21:41:12.049008 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.048921    2575 scope.go:117] "RemoveContainer" containerID="e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0"
Jul 27 21:41:12.058266 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.058250    2575 scope.go:117] "RemoveContainer" containerID="e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0"
Jul 27 21:41:12.058566 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:41:12.058546    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0\": container with ID starting with e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0 not found: ID does not exist" containerID="e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0"
Jul 27 21:41:12.058642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.058572    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0"} err="failed to get container status \"e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0\": rpc error: code = NotFound desc = could not find container \"e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0\": container with ID starting with e1c70bb03d4907e9f0c57f625415b6ccef25c220d68011b1e2f3fbd226b1fca0 not found: ID does not exist"
Jul 27 21:41:12.058642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.058589    2575 scope.go:117] "RemoveContainer" containerID="f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515"
Jul 27 21:41:12.067642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.067600    2575 scope.go:117] "RemoveContainer" containerID="f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515"
Jul 27 21:41:12.067894 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:41:12.067876    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515\": container with ID starting with f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515 not found: ID does not exist" containerID="f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515"
Jul 27 21:41:12.068019 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.067903    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515"} err="failed to get container status \"f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515\": rpc error: code = NotFound desc = could not find container \"f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515\": container with ID starting with f4cc05a2d32d045c7a677446f92fb1f4815d358ff572ef7d7d7933318c4ac515 not found: ID does not exist"
Jul 27 21:41:12.069056 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.069038    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"]
Jul 27 21:41:12.073006 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.072980    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-740aee-db688cb99-pdd2p"]
Jul 27 21:41:12.087377 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.087353    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"]
Jul 27 21:41:12.090607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.090588    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-740aee-649449f4bd-cvqwp"]
Jul 27 21:41:12.100040 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.100021    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"]
Jul 27 21:41:12.104638 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.104616    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-740aee-6997d76b86-whbgd"]
Jul 27 21:41:12.277909 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.277868    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b970bf-c1b8-4e5d-adac-2e81b1ae0832" path="/var/lib/kubelet/pods/15b970bf-c1b8-4e5d-adac-2e81b1ae0832/volumes"
Jul 27 21:41:12.278450 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.278429    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da24537-8522-4d3d-ba2d-b56a9293e1e9" path="/var/lib/kubelet/pods/2da24537-8522-4d3d-ba2d-b56a9293e1e9/volumes"
Jul 27 21:41:12.278807 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:12.278790    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2" path="/var/lib/kubelet/pods/cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2/volumes"
Jul 27 21:41:22.130027 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.129994    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"]
Jul 27 21:41:22.130717 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.130695    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9881ea79-840f-4476-8748-194c3d533ead" containerName="payload-processing"
Jul 27 21:41:22.130865 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.130849    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9881ea79-840f-4476-8748-194c3d533ead" containerName="payload-processing"
Jul 27 21:41:22.130982 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.130969    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe457f8-4341-4cfd-93e2-910e88847f97" containerName="maas-api"
Jul 27 21:41:22.131074 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131056    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe457f8-4341-4cfd-93e2-910e88847f97" containerName="maas-api"
Jul 27 21:41:22.131139 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131083    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b970bf-c1b8-4e5d-adac-2e81b1ae0832" containerName="maas-api"
Jul 27 21:41:22.131139 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131092    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b970bf-c1b8-4e5d-adac-2e81b1ae0832" containerName="maas-api"
Jul 27 21:41:22.131139 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131102    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2" containerName="payload-pre-processing"
Jul 27 21:41:22.131139 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131111    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2" containerName="payload-pre-processing"
Jul 27 21:41:22.131367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131138    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d08f514-56da-4e7a-83bb-6e7ce5c208ae" containerName="payload-pre-processing"
Jul 27 21:41:22.131367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131148    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d08f514-56da-4e7a-83bb-6e7ce5c208ae" containerName="payload-pre-processing"
Jul 27 21:41:22.131367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131173    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da24537-8522-4d3d-ba2d-b56a9293e1e9" containerName="payload-processing"
Jul 27 21:41:22.131367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131182    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da24537-8522-4d3d-ba2d-b56a9293e1e9" containerName="payload-processing"
Jul 27 21:41:22.131367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131348    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe457f8-4341-4cfd-93e2-910e88847f97" containerName="maas-api"
Jul 27 21:41:22.131367 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131366    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9881ea79-840f-4476-8748-194c3d533ead" containerName="payload-processing"
Jul 27 21:41:22.131657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131377    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da24537-8522-4d3d-ba2d-b56a9293e1e9" containerName="payload-processing"
Jul 27 21:41:22.131657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131387    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b970bf-c1b8-4e5d-adac-2e81b1ae0832" containerName="maas-api"
Jul 27 21:41:22.131657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131399    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0483ba-5eff-4dcf-9d6e-0818bcb5f3a2" containerName="payload-pre-processing"
Jul 27 21:41:22.131657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.131409    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d08f514-56da-4e7a-83bb-6e7ce5c208ae" containerName="payload-pre-processing"
Jul 27 21:41:22.134737 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.134716    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.137128 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.137108    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-3298cd-serving-cert\""
Jul 27 21:41:22.152638 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.152607    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"]
Jul 27 21:41:22.183038 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.183007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42758382-db55-410c-9301-231d7f830496-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.183038 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.183038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnjv2\" (UniqueName: \"kubernetes.io/projected/42758382-db55-410c-9301-231d7f830496-kube-api-access-lnjv2\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.183247 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.183081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.283671 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.283633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.283874 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:41:22.283772    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-serving-cert: secret "maas-api-e2e-shared-a-3298cd-serving-cert" not found
Jul 27 21:41:22.283874 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.283774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42758382-db55-410c-9301-231d7f830496-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.283874 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:41:22.283841    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls podName:42758382-db55-410c-9301-231d7f830496 nodeName:}" failed. No retries permitted until 2026-07-27 21:41:22.78382472 +0000 UTC m=+2627.049538816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls") pod "maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d" (UID: "42758382-db55-410c-9301-231d7f830496") : secret "maas-api-e2e-shared-a-3298cd-serving-cert" not found
Jul 27 21:41:22.284069 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.283901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnjv2\" (UniqueName: \"kubernetes.io/projected/42758382-db55-410c-9301-231d7f830496-kube-api-access-lnjv2\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.284443 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.284413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42758382-db55-410c-9301-231d7f830496-openshift-service-ca\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.292988 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.292959    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnjv2\" (UniqueName: \"kubernetes.io/projected/42758382-db55-410c-9301-231d7f830496-kube-api-access-lnjv2\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.787658 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.787623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.790238 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.790186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls\") pod \"maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d\" (UID: \"42758382-db55-410c-9301-231d7f830496\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:22.803687 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.803661    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"]
Jul 27 21:41:22.807286 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.807270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:22.810388 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.810369    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-3298cd\""
Jul 27 21:41:22.819334 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.819311    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"]
Jul 27 21:41:22.855096 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.855062    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"]
Jul 27 21:41:22.858725 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.858709    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:22.861359 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.861335    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-3298cd-dockercfg-dhddw\""
Jul 27 21:41:22.867009 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.866987    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"]
Jul 27 21:41:22.888121 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.888090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzdph\" (UniqueName: \"kubernetes.io/projected/1b70d340-9041-428f-8c0f-2cbb47dfb312-kube-api-access-kzdph\") pod \"payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv\" (UID: \"1b70d340-9041-428f-8c0f-2cbb47dfb312\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:22.888279 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.888132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rjb7\" (UniqueName: \"kubernetes.io/projected/fdaafcc5-be9b-4c08-95d4-600556fd49e6-kube-api-access-2rjb7\") pod \"payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726\" (UID: \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:22.888279 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.888255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b70d340-9041-428f-8c0f-2cbb47dfb312-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv\" (UID: \"1b70d340-9041-428f-8c0f-2cbb47dfb312\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:22.888386 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.888302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdaafcc5-be9b-4c08-95d4-600556fd49e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726\" (UID: \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:22.989576 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.989539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b70d340-9041-428f-8c0f-2cbb47dfb312-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv\" (UID: \"1b70d340-9041-428f-8c0f-2cbb47dfb312\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:22.989771 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.989585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdaafcc5-be9b-4c08-95d4-600556fd49e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726\" (UID: \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:22.989771 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.989638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzdph\" (UniqueName: \"kubernetes.io/projected/1b70d340-9041-428f-8c0f-2cbb47dfb312-kube-api-access-kzdph\") pod \"payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv\" (UID: \"1b70d340-9041-428f-8c0f-2cbb47dfb312\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:22.989771 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.989660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rjb7\" (UniqueName: \"kubernetes.io/projected/fdaafcc5-be9b-4c08-95d4-600556fd49e6-kube-api-access-2rjb7\") pod \"payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726\" (UID: \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:22.990338 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.990315    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b70d340-9041-428f-8c0f-2cbb47dfb312-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv\" (UID: \"1b70d340-9041-428f-8c0f-2cbb47dfb312\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:22.990449 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.990378    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdaafcc5-be9b-4c08-95d4-600556fd49e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726\" (UID: \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:22.997600 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.997580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzdph\" (UniqueName: \"kubernetes.io/projected/1b70d340-9041-428f-8c0f-2cbb47dfb312-kube-api-access-kzdph\") pod \"payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv\" (UID: \"1b70d340-9041-428f-8c0f-2cbb47dfb312\") " pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:22.997767 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:22.997750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rjb7\" (UniqueName: \"kubernetes.io/projected/fdaafcc5-be9b-4c08-95d4-600556fd49e6-kube-api-access-2rjb7\") pod \"payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726\" (UID: \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:23.051446 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:23.051363    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:23.119660 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:23.119630    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:23.169960 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:23.169926    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:23.214286 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:23.214252    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"]
Jul 27 21:41:23.217323 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:41:23.217235    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42758382_db55_410c_9301_231d7f830496.slice/crio-0d47e7482c2f2fff183907f738b34828e5666d85aa27274fee9e111d6186499e WatchSource:0}: Error finding container 0d47e7482c2f2fff183907f738b34828e5666d85aa27274fee9e111d6186499e: Status 404 returned error can't find the container with id 0d47e7482c2f2fff183907f738b34828e5666d85aa27274fee9e111d6186499e
Jul 27 21:41:23.288056 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:23.288024    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"]
Jul 27 21:41:23.290167 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:41:23.290133    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b70d340_9041_428f_8c0f_2cbb47dfb312.slice/crio-b8836810a825cf3251fea529b5008e93ca5b30f4868b3829325f072d08aae91d WatchSource:0}: Error finding container b8836810a825cf3251fea529b5008e93ca5b30f4868b3829325f072d08aae91d: Status 404 returned error can't find the container with id b8836810a825cf3251fea529b5008e93ca5b30f4868b3829325f072d08aae91d
Jul 27 21:41:23.341907 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:23.341885    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"]
Jul 27 21:41:23.344053 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:41:23.344026    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdaafcc5_be9b_4c08_95d4_600556fd49e6.slice/crio-f7869231631daa34f7eda49918f6344bb3c0fb994fe3b39b8633a4119d7f2edb WatchSource:0}: Error finding container f7869231631daa34f7eda49918f6344bb3c0fb994fe3b39b8633a4119d7f2edb: Status 404 returned error can't find the container with id f7869231631daa34f7eda49918f6344bb3c0fb994fe3b39b8633a4119d7f2edb
Jul 27 21:41:24.114328 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.114202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d" event={"ID":"42758382-db55-410c-9301-231d7f830496","Type":"ContainerStarted","Data":"7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9"}
Jul 27 21:41:24.114328 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.114285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d" event={"ID":"42758382-db55-410c-9301-231d7f830496","Type":"ContainerStarted","Data":"0d47e7482c2f2fff183907f738b34828e5666d85aa27274fee9e111d6186499e"}
Jul 27 21:41:24.114567 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.114419    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:24.119318 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.119278    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv" event={"ID":"1b70d340-9041-428f-8c0f-2cbb47dfb312","Type":"ContainerStarted","Data":"5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12"}
Jul 27 21:41:24.119458 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.119324    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv" event={"ID":"1b70d340-9041-428f-8c0f-2cbb47dfb312","Type":"ContainerStarted","Data":"b8836810a825cf3251fea529b5008e93ca5b30f4868b3829325f072d08aae91d"}
Jul 27 21:41:24.119458 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.119355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:24.121174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.121147    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726" event={"ID":"fdaafcc5-be9b-4c08-95d4-600556fd49e6","Type":"ContainerStarted","Data":"d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6"}
Jul 27 21:41:24.121299 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.121194    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726" event={"ID":"fdaafcc5-be9b-4c08-95d4-600556fd49e6","Type":"ContainerStarted","Data":"f7869231631daa34f7eda49918f6344bb3c0fb994fe3b39b8633a4119d7f2edb"}
Jul 27 21:41:24.121299 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.121250    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:24.133983 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.133941    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d" podStartSLOduration=1.58121415 podStartE2EDuration="2.133926042s" totalImagesPullingTime="552.711892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:24.132422352 +0000 UTC m=+2628.398136472" watchObservedRunningTime="2026-07-27 21:41:24.133926042 +0000 UTC m=+2628.399640159"
Jul 27 21:41:24.150231 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.150158    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv" podStartSLOduration=2.150139055 podStartE2EDuration="2.150139055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:24.148023338 +0000 UTC m=+2628.413737456" watchObservedRunningTime="2026-07-27 21:41:24.150139055 +0000 UTC m=+2628.415853175"
Jul 27 21:41:24.165613 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:24.165562    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726" podStartSLOduration=2.165543225 podStartE2EDuration="2.165543225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:24.162375406 +0000 UTC m=+2628.428089527" watchObservedRunningTime="2026-07-27 21:41:24.165543225 +0000 UTC m=+2628.431257344"
Jul 27 21:41:30.133065 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.133033    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:41:30.214544 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.214509    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"]
Jul 27 21:41:30.220779 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.220753    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.225354 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.225330    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-2cf6fc-serving-cert\""
Jul 27 21:41:30.235108 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.235081    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"]
Jul 27 21:41:30.255228 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.255178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37051792-133c-4efa-af10-8d4bb2d25488-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.255383 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.255258    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.255383 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.255308    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k4rg\" (UniqueName: \"kubernetes.io/projected/37051792-133c-4efa-af10-8d4bb2d25488-kube-api-access-8k4rg\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.356800 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.356766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.356973 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.356840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k4rg\" (UniqueName: \"kubernetes.io/projected/37051792-133c-4efa-af10-8d4bb2d25488-kube-api-access-8k4rg\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.356973 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:41:30.356923    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-serving-cert: secret "maas-api-e2e-shared-b-2cf6fc-serving-cert" not found
Jul 27 21:41:30.357433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.357405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37051792-133c-4efa-af10-8d4bb2d25488-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.358003 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.357967    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37051792-133c-4efa-af10-8d4bb2d25488-openshift-service-ca\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.358003 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:41:30.357989    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls podName:37051792-133c-4efa-af10-8d4bb2d25488 nodeName:}" failed. No retries permitted until 2026-07-27 21:41:30.857960141 +0000 UTC m=+2635.123674249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls") pod "maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t" (UID: "37051792-133c-4efa-af10-8d4bb2d25488") : secret "maas-api-e2e-shared-b-2cf6fc-serving-cert" not found
Jul 27 21:41:30.371892 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.371867    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k4rg\" (UniqueName: \"kubernetes.io/projected/37051792-133c-4efa-af10-8d4bb2d25488-kube-api-access-8k4rg\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.862667 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.862628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:30.865364 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:30.865340    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls\") pod \"maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:31.010940 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.010894    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"]
Jul 27 21:41:31.014591 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.014574    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:31.017363 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.017345    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-2cf6fc\""
Jul 27 21:41:31.025434 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.025407    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"]
Jul 27 21:41:31.051157 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.051125    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"]
Jul 27 21:41:31.055469 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.055446    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:31.058075 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.058057    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-2cf6fc-dockercfg-pwz92\""
Jul 27 21:41:31.064103 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.064079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpvt7\" (UniqueName: \"kubernetes.io/projected/22d24984-59b4-47a3-b456-5a3ec4f1818f-kube-api-access-bpvt7\") pod \"payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57\" (UID: \"22d24984-59b4-47a3-b456-5a3ec4f1818f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:31.064245 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.064180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22d24984-59b4-47a3-b456-5a3ec4f1818f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57\" (UID: \"22d24984-59b4-47a3-b456-5a3ec4f1818f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:31.064856 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.064836    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"]
Jul 27 21:41:31.133285 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.133022    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:31.165452 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.165416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpvt7\" (UniqueName: \"kubernetes.io/projected/22d24984-59b4-47a3-b456-5a3ec4f1818f-kube-api-access-bpvt7\") pod \"payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57\" (UID: \"22d24984-59b4-47a3-b456-5a3ec4f1818f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:31.165639 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.165485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22d24984-59b4-47a3-b456-5a3ec4f1818f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57\" (UID: \"22d24984-59b4-47a3-b456-5a3ec4f1818f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:31.165639 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.165564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e676a7a-5190-47c4-a835-819c38260956-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz\" (UID: \"2e676a7a-5190-47c4-a835-819c38260956\") " pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:31.165639 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.165591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfh7p\" (UniqueName: \"kubernetes.io/projected/2e676a7a-5190-47c4-a835-819c38260956-kube-api-access-tfh7p\") pod \"payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz\" (UID: \"2e676a7a-5190-47c4-a835-819c38260956\") " pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:31.166266 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.166244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22d24984-59b4-47a3-b456-5a3ec4f1818f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57\" (UID: \"22d24984-59b4-47a3-b456-5a3ec4f1818f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:31.173799 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.173767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpvt7\" (UniqueName: \"kubernetes.io/projected/22d24984-59b4-47a3-b456-5a3ec4f1818f-kube-api-access-bpvt7\") pod \"payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57\" (UID: \"22d24984-59b4-47a3-b456-5a3ec4f1818f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:31.267088 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.267053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e676a7a-5190-47c4-a835-819c38260956-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz\" (UID: \"2e676a7a-5190-47c4-a835-819c38260956\") " pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:31.267307 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.267098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfh7p\" (UniqueName: \"kubernetes.io/projected/2e676a7a-5190-47c4-a835-819c38260956-kube-api-access-tfh7p\") pod \"payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz\" (UID: \"2e676a7a-5190-47c4-a835-819c38260956\") " pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:31.268020 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.267981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e676a7a-5190-47c4-a835-819c38260956-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz\" (UID: \"2e676a7a-5190-47c4-a835-819c38260956\") " pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:31.275830 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.275803    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfh7p\" (UniqueName: \"kubernetes.io/projected/2e676a7a-5190-47c4-a835-819c38260956-kube-api-access-tfh7p\") pod \"payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz\" (UID: \"2e676a7a-5190-47c4-a835-819c38260956\") " pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:31.283998 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.283977    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"]
Jul 27 21:41:31.285369 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:41:31.285345    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37051792_133c_4efa_af10_8d4bb2d25488.slice/crio-34855651f1772ed902dd5d3a9e4d33a00b3c123b644c14d8b8cbae02e00c6811 WatchSource:0}: Error finding container 34855651f1772ed902dd5d3a9e4d33a00b3c123b644c14d8b8cbae02e00c6811: Status 404 returned error can't find the container with id 34855651f1772ed902dd5d3a9e4d33a00b3c123b644c14d8b8cbae02e00c6811
Jul 27 21:41:31.327783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.327758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:31.368022 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.367995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:31.686710 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.686681    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"]
Jul 27 21:41:31.688425 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:41:31.688393    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d24984_59b4_47a3_b456_5a3ec4f1818f.slice/crio-ba6ff6338ecbeed30d0ee7fd4995eb962b336ba13470269508ae74a9d8a5b23a WatchSource:0}: Error finding container ba6ff6338ecbeed30d0ee7fd4995eb962b336ba13470269508ae74a9d8a5b23a: Status 404 returned error can't find the container with id ba6ff6338ecbeed30d0ee7fd4995eb962b336ba13470269508ae74a9d8a5b23a
Jul 27 21:41:31.741882 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:31.741860    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"]
Jul 27 21:41:31.743506 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:41:31.743481    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e676a7a_5190_47c4_a835_819c38260956.slice/crio-4cf16a18f2c247bf83d4c52d59623547756daf064364aea8f7c4d03cae039b1f WatchSource:0}: Error finding container 4cf16a18f2c247bf83d4c52d59623547756daf064364aea8f7c4d03cae039b1f: Status 404 returned error can't find the container with id 4cf16a18f2c247bf83d4c52d59623547756daf064364aea8f7c4d03cae039b1f
Jul 27 21:41:32.168902 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.168851    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz" event={"ID":"2e676a7a-5190-47c4-a835-819c38260956","Type":"ContainerStarted","Data":"281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904"}
Jul 27 21:41:32.169417 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.169016    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:32.169417 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.169042    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz" event={"ID":"2e676a7a-5190-47c4-a835-819c38260956","Type":"ContainerStarted","Data":"4cf16a18f2c247bf83d4c52d59623547756daf064364aea8f7c4d03cae039b1f"}
Jul 27 21:41:32.170383 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.170356    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t" event={"ID":"37051792-133c-4efa-af10-8d4bb2d25488","Type":"ContainerStarted","Data":"990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b"}
Jul 27 21:41:32.170508 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.170403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t" event={"ID":"37051792-133c-4efa-af10-8d4bb2d25488","Type":"ContainerStarted","Data":"34855651f1772ed902dd5d3a9e4d33a00b3c123b644c14d8b8cbae02e00c6811"}
Jul 27 21:41:32.170508 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.170430    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:32.172008 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.171987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57" event={"ID":"22d24984-59b4-47a3-b456-5a3ec4f1818f","Type":"ContainerStarted","Data":"fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77"}
Jul 27 21:41:32.172131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.172024    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57" event={"ID":"22d24984-59b4-47a3-b456-5a3ec4f1818f","Type":"ContainerStarted","Data":"ba6ff6338ecbeed30d0ee7fd4995eb962b336ba13470269508ae74a9d8a5b23a"}
Jul 27 21:41:32.172131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.172074    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:41:32.185811 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.185763    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz" podStartSLOduration=1.185747415 podStartE2EDuration="1.185747415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:32.184707888 +0000 UTC m=+2636.450422006" watchObservedRunningTime="2026-07-27 21:41:32.185747415 +0000 UTC m=+2636.451461514"
Jul 27 21:41:32.202332 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.202291    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t" podStartSLOduration=1.806336578 podStartE2EDuration="2.202277856s" totalImagesPullingTime="395.941278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:32.200401759 +0000 UTC m=+2636.466115887" watchObservedRunningTime="2026-07-27 21:41:32.202277856 +0000 UTC m=+2636.467991974"
Jul 27 21:41:32.215048 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:32.215006    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57" podStartSLOduration=2.214994652 podStartE2EDuration="2.214994652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:41:32.213374089 +0000 UTC m=+2636.479088236" watchObservedRunningTime="2026-07-27 21:41:32.214994652 +0000 UTC m=+2636.480708770"
Jul 27 21:41:35.128465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:35.128432    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:41:35.128957 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:35.128683    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:41:38.183516 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:38.183487    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:41:43.179338 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:43.179244    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:41:43.179338 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:41:43.179318    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:44:36.596138 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:44:36.596103    2575 scope.go:117] "RemoveContainer" containerID="7e2b830aa410fa530781a25da6b82ffed37c80cc166fe42051f256047c38a2a7"
Jul 27 21:46:44.508169 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.508132    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"]
Jul 27 21:46:44.512010 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.511988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.514502 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.514482    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3298cd\"/\"openshift-service-ca.crt\""
Jul 27 21:46:44.515329 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.515312    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3298cd\"/\"sub-test-model-3298cd-kserve-self-signed-certs\""
Jul 27 21:46:44.515436 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.515362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3298cd\"/\"kube-root-ca.crt\""
Jul 27 21:46:44.515436 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.515380    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3298cd\"/\"default-dockercfg-sfxzx\""
Jul 27 21:46:44.523410 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.523383    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"]
Jul 27 21:46:44.646038 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.646006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5e4823-7314-493a-8ae9-7beab67cc29c-tls-certs\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.646227 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.646050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-dshm\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.646227 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.646074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc9mn\" (UniqueName: \"kubernetes.io/projected/8e5e4823-7314-493a-8ae9-7beab67cc29c-kube-api-access-tc9mn\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.646227 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.646156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-tmp-dir\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.646227 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.646196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-model-cache\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.646395 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.646240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-home\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747139 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-dshm\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747139 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc9mn\" (UniqueName: \"kubernetes.io/projected/8e5e4823-7314-493a-8ae9-7beab67cc29c-kube-api-access-tc9mn\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747408 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-tmp-dir\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747408 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-model-cache\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747496 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-home\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747564 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5e4823-7314-493a-8ae9-7beab67cc29c-tls-certs\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747639 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747611    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-tmp-dir\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747754 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-model-cache\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.747799 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.747771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-home\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.749605 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.749584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-dshm\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.750037 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.750019    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5e4823-7314-493a-8ae9-7beab67cc29c-tls-certs\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.757333 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.757310    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc9mn\" (UniqueName: \"kubernetes.io/projected/8e5e4823-7314-493a-8ae9-7beab67cc29c-kube-api-access-tc9mn\") pod \"sub-test-model-3298cd-kserve-8548b58569-n2qmr\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") " pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.821463 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.821392    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:44.965635 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:44.965603    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"]
Jul 27 21:46:44.970717 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:46:44.970687    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e5e4823_7314_493a_8ae9_7beab67cc29c.slice/crio-f608314af58263e688546c8597482371c2c82619013442416bb01d92d5ce9a2a WatchSource:0}: Error finding container f608314af58263e688546c8597482371c2c82619013442416bb01d92d5ce9a2a: Status 404 returned error can't find the container with id f608314af58263e688546c8597482371c2c82619013442416bb01d92d5ce9a2a
Jul 27 21:46:45.842457 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:45.842414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr" event={"ID":"8e5e4823-7314-493a-8ae9-7beab67cc29c","Type":"ContainerStarted","Data":"f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2"}
Jul 27 21:46:45.842457 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:45.842468    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr" event={"ID":"8e5e4823-7314-493a-8ae9-7beab67cc29c","Type":"ContainerStarted","Data":"f608314af58263e688546c8597482371c2c82619013442416bb01d92d5ce9a2a"}
Jul 27 21:46:45.870011 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:45.869955    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr" podStartSLOduration=1.8699401340000001 podStartE2EDuration="1.869940134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:46:45.867914408 +0000 UTC m=+2950.133628526" watchObservedRunningTime="2026-07-27 21:46:45.869940134 +0000 UTC m=+2950.135654252"
Jul 27 21:46:54.821686 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:54.821644    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:54.821686 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:54.821694    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:54.835585 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:54.835548    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:46:54.903080 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:46:54.903052    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:48:43.021484 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:43.021447    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"]
Jul 27 21:48:58.041227 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.041165    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr" podUID="8e5e4823-7314-493a-8ae9-7beab67cc29c" containerName="main" containerID="cri-o://f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2" gracePeriod=45
Jul 27 21:48:58.299334 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.299280    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:48:58.409981 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.409956    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc9mn\" (UniqueName: \"kubernetes.io/projected/8e5e4823-7314-493a-8ae9-7beab67cc29c-kube-api-access-tc9mn\") pod \"8e5e4823-7314-493a-8ae9-7beab67cc29c\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") "
Jul 27 21:48:58.410174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.410001    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-dshm\") pod \"8e5e4823-7314-493a-8ae9-7beab67cc29c\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") "
Jul 27 21:48:58.410174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.410022    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5e4823-7314-493a-8ae9-7beab67cc29c-tls-certs\") pod \"8e5e4823-7314-493a-8ae9-7beab67cc29c\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") "
Jul 27 21:48:58.410174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.410046    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-home\") pod \"8e5e4823-7314-493a-8ae9-7beab67cc29c\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") "
Jul 27 21:48:58.410174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.410077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-model-cache\") pod \"8e5e4823-7314-493a-8ae9-7beab67cc29c\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") "
Jul 27 21:48:58.410174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.410117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-tmp-dir\") pod \"8e5e4823-7314-493a-8ae9-7beab67cc29c\" (UID: \"8e5e4823-7314-493a-8ae9-7beab67cc29c\") "
Jul 27 21:48:58.410506 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.410404    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-home" (OuterVolumeSpecName: "home") pod "8e5e4823-7314-493a-8ae9-7beab67cc29c" (UID: "8e5e4823-7314-493a-8ae9-7beab67cc29c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:48:58.410506 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.410420    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-model-cache" (OuterVolumeSpecName: "model-cache") pod "8e5e4823-7314-493a-8ae9-7beab67cc29c" (UID: "8e5e4823-7314-493a-8ae9-7beab67cc29c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:48:58.410506 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.410450    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8e5e4823-7314-493a-8ae9-7beab67cc29c" (UID: "8e5e4823-7314-493a-8ae9-7beab67cc29c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:48:58.412417 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.412385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-dshm" (OuterVolumeSpecName: "dshm") pod "8e5e4823-7314-493a-8ae9-7beab67cc29c" (UID: "8e5e4823-7314-493a-8ae9-7beab67cc29c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:48:58.412533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.412485    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5e4823-7314-493a-8ae9-7beab67cc29c-kube-api-access-tc9mn" (OuterVolumeSpecName: "kube-api-access-tc9mn") pod "8e5e4823-7314-493a-8ae9-7beab67cc29c" (UID: "8e5e4823-7314-493a-8ae9-7beab67cc29c"). InnerVolumeSpecName "kube-api-access-tc9mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:48:58.412533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.412514    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e5e4823-7314-493a-8ae9-7beab67cc29c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8e5e4823-7314-493a-8ae9-7beab67cc29c" (UID: "8e5e4823-7314-493a-8ae9-7beab67cc29c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:48:58.511695 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.511667    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc9mn\" (UniqueName: \"kubernetes.io/projected/8e5e4823-7314-493a-8ae9-7beab67cc29c-kube-api-access-tc9mn\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:48:58.511695 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.511692    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-dshm\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:48:58.511695 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.511702    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5e4823-7314-493a-8ae9-7beab67cc29c-tls-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:48:58.511923 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.511712    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-home\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:48:58.511923 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.511720    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-model-cache\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:48:58.511923 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.511747    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e4823-7314-493a-8ae9-7beab67cc29c-tmp-dir\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:48:58.567703 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.567615    2575 generic.go:356] "Generic (PLEG): container finished" podID="8e5e4823-7314-493a-8ae9-7beab67cc29c" containerID="f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2" exitCode=0
Jul 27 21:48:58.567703 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.567663    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr" event={"ID":"8e5e4823-7314-493a-8ae9-7beab67cc29c","Type":"ContainerDied","Data":"f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2"}
Jul 27 21:48:58.567703 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.567695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr" event={"ID":"8e5e4823-7314-493a-8ae9-7beab67cc29c","Type":"ContainerDied","Data":"f608314af58263e688546c8597482371c2c82619013442416bb01d92d5ce9a2a"}
Jul 27 21:48:58.567930 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.567711    2575 scope.go:117] "RemoveContainer" containerID="f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2"
Jul 27 21:48:58.567930 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.567668    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"
Jul 27 21:48:58.577483 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.577468    2575 scope.go:117] "RemoveContainer" containerID="f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2"
Jul 27 21:48:58.577756 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:48:58.577738    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2\": container with ID starting with f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2 not found: ID does not exist" containerID="f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2"
Jul 27 21:48:58.577801 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.577765    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2"} err="failed to get container status \"f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2\": rpc error: code = NotFound desc = could not find container \"f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2\": container with ID starting with f80a66571422061b3e862f919f1525253c64ddfd12ba033709c8d837faf58bd2 not found: ID does not exist"
Jul 27 21:48:58.589131 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.589105    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"]
Jul 27 21:48:58.593324 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:48:58.593305    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3298cd/sub-test-model-3298cd-kserve-8548b58569-n2qmr"]
Jul 27 21:49:00.278818 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:00.278780    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e5e4823-7314-493a-8ae9-7beab67cc29c" path="/var/lib/kubelet/pods/8e5e4823-7314-493a-8ae9-7beab67cc29c/volumes"
Jul 27 21:49:29.202992 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.202959    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"]
Jul 27 21:49:29.203490 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.203418    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5e4823-7314-493a-8ae9-7beab67cc29c" containerName="main"
Jul 27 21:49:29.203490 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.203430    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5e4823-7314-493a-8ae9-7beab67cc29c" containerName="main"
Jul 27 21:49:29.203565 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.203504    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5e4823-7314-493a-8ae9-7beab67cc29c" containerName="main"
Jul 27 21:49:29.206415 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.206394    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.212889 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.212873    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2cf6fc\"/\"default-dockercfg-cpn4m\""
Jul 27 21:49:29.213406 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.213382    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2cf6fc\"/\"kube-root-ca.crt\""
Jul 27 21:49:29.213534 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.213392    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-2cf6fc\"/\"rate-test-model-2cf6fc-kserve-self-signed-certs\""
Jul 27 21:49:29.213534 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.213392    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-2cf6fc\"/\"openshift-service-ca.crt\""
Jul 27 21:49:29.218126 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.218105    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"]
Jul 27 21:49:29.303858 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.303819    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp469\" (UniqueName: \"kubernetes.io/projected/901fff62-853f-483f-8c52-e9c76d420b71-kube-api-access-bp469\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.304043 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.303885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-dshm\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.304043 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.304013    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/901fff62-853f-483f-8c52-e9c76d420b71-tls-certs\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.304129 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.304056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-home\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.304193 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.304171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-model-cache\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.304267 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.304248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-tmp-dir\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405091 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp469\" (UniqueName: \"kubernetes.io/projected/901fff62-853f-483f-8c52-e9c76d420b71-kube-api-access-bp469\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405324 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-dshm\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405324 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/901fff62-853f-483f-8c52-e9c76d420b71-tls-certs\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405324 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-home\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405324 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-model-cache\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405570 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-tmp-dir\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405701 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405681    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-tmp-dir\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405761 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-model-cache\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.405761 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.405742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-home\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.407566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.407543    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-dshm\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.407845 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.407828    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/901fff62-853f-483f-8c52-e9c76d420b71-tls-certs\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.413842 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.413823    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp469\" (UniqueName: \"kubernetes.io/projected/901fff62-853f-483f-8c52-e9c76d420b71-kube-api-access-bp469\") pod \"rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") " pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.515517 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.515486    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:29.659390 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.659362    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"]
Jul 27 21:49:29.660845 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:49:29.660813    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod901fff62_853f_483f_8c52_e9c76d420b71.slice/crio-79f265552e34db7bc5d5ef3383dad1b4bc654cddf69e8db4c95a6283678add32 WatchSource:0}: Error finding container 79f265552e34db7bc5d5ef3383dad1b4bc654cddf69e8db4c95a6283678add32: Status 404 returned error can't find the container with id 79f265552e34db7bc5d5ef3383dad1b4bc654cddf69e8db4c95a6283678add32
Jul 27 21:49:29.732309 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.732264    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf" event={"ID":"901fff62-853f-483f-8c52-e9c76d420b71","Type":"ContainerStarted","Data":"4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f"}
Jul 27 21:49:29.732309 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.732314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf" event={"ID":"901fff62-853f-483f-8c52-e9c76d420b71","Type":"ContainerStarted","Data":"79f265552e34db7bc5d5ef3383dad1b4bc654cddf69e8db4c95a6283678add32"}
Jul 27 21:49:29.750768 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:29.750716    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf" podStartSLOduration=0.750698881 podStartE2EDuration="750.698881ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:49:29.748952891 +0000 UTC m=+3114.014667048" watchObservedRunningTime="2026-07-27 21:49:29.750698881 +0000 UTC m=+3114.016412999"
Jul 27 21:49:39.515763 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:39.515729    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:39.516297 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:39.516004    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:39.528933 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:39.528905    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:49:39.795099 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:49:39.795018    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:50:30.715807 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:30.715775    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"]
Jul 27 21:50:45.735857 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:45.735810    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf" podUID="901fff62-853f-483f-8c52-e9c76d420b71" containerName="main" containerID="cri-o://4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f" gracePeriod=45
Jul 27 21:50:46.002482 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.002457    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:50:46.125539 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.125506    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-home\") pod \"901fff62-853f-483f-8c52-e9c76d420b71\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") "
Jul 27 21:50:46.125744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.125562    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-dshm\") pod \"901fff62-853f-483f-8c52-e9c76d420b71\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") "
Jul 27 21:50:46.125744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.125594    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-tmp-dir\") pod \"901fff62-853f-483f-8c52-e9c76d420b71\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") "
Jul 27 21:50:46.125744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.125642    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/901fff62-853f-483f-8c52-e9c76d420b71-tls-certs\") pod \"901fff62-853f-483f-8c52-e9c76d420b71\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") "
Jul 27 21:50:46.125744 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.125721    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp469\" (UniqueName: \"kubernetes.io/projected/901fff62-853f-483f-8c52-e9c76d420b71-kube-api-access-bp469\") pod \"901fff62-853f-483f-8c52-e9c76d420b71\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") "
Jul 27 21:50:46.125970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.125748    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-model-cache\") pod \"901fff62-853f-483f-8c52-e9c76d420b71\" (UID: \"901fff62-853f-483f-8c52-e9c76d420b71\") "
Jul 27 21:50:46.125970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.125747    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-home" (OuterVolumeSpecName: "home") pod "901fff62-853f-483f-8c52-e9c76d420b71" (UID: "901fff62-853f-483f-8c52-e9c76d420b71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:50:46.125970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.125876    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "901fff62-853f-483f-8c52-e9c76d420b71" (UID: "901fff62-853f-483f-8c52-e9c76d420b71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:50:46.126135 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.126103    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-model-cache" (OuterVolumeSpecName: "model-cache") pod "901fff62-853f-483f-8c52-e9c76d420b71" (UID: "901fff62-853f-483f-8c52-e9c76d420b71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:50:46.126201 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.126178    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-tmp-dir\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:50:46.126297 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.126202    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-home\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:50:46.128030 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.127992    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-dshm" (OuterVolumeSpecName: "dshm") pod "901fff62-853f-483f-8c52-e9c76d420b71" (UID: "901fff62-853f-483f-8c52-e9c76d420b71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 21:50:46.128166 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.128055    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901fff62-853f-483f-8c52-e9c76d420b71-kube-api-access-bp469" (OuterVolumeSpecName: "kube-api-access-bp469") pod "901fff62-853f-483f-8c52-e9c76d420b71" (UID: "901fff62-853f-483f-8c52-e9c76d420b71"). InnerVolumeSpecName "kube-api-access-bp469". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:50:46.128166 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.128108    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/901fff62-853f-483f-8c52-e9c76d420b71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "901fff62-853f-483f-8c52-e9c76d420b71" (UID: "901fff62-853f-483f-8c52-e9c76d420b71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:50:46.132193 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.132168    2575 generic.go:356] "Generic (PLEG): container finished" podID="901fff62-853f-483f-8c52-e9c76d420b71" containerID="4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f" exitCode=0
Jul 27 21:50:46.132323 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.132226    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"
Jul 27 21:50:46.132323 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.132247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf" event={"ID":"901fff62-853f-483f-8c52-e9c76d420b71","Type":"ContainerDied","Data":"4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f"}
Jul 27 21:50:46.132323 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.132302    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf" event={"ID":"901fff62-853f-483f-8c52-e9c76d420b71","Type":"ContainerDied","Data":"79f265552e34db7bc5d5ef3383dad1b4bc654cddf69e8db4c95a6283678add32"}
Jul 27 21:50:46.132323 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.132321    2575 scope.go:117] "RemoveContainer" containerID="4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f"
Jul 27 21:50:46.150128 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.150107    2575 scope.go:117] "RemoveContainer" containerID="4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f"
Jul 27 21:50:46.150495 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:50:46.150475    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f\": container with ID starting with 4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f not found: ID does not exist" containerID="4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f"
Jul 27 21:50:46.150566 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.150508    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f"} err="failed to get container status \"4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f\": rpc error: code = NotFound desc = could not find container \"4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f\": container with ID starting with 4fdea18a4b6872a32327ebc37e53065b6728b439cd5e3c3c02516364f853dd2f not found: ID does not exist"
Jul 27 21:50:46.162554 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.162532    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"]
Jul 27 21:50:46.166740 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.166720    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-2cf6fc/rate-test-model-2cf6fc-kserve-9c66f877f-vcdcf"]
Jul 27 21:50:46.227645 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.227620    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp469\" (UniqueName: \"kubernetes.io/projected/901fff62-853f-483f-8c52-e9c76d420b71-kube-api-access-bp469\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:50:46.227645 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.227643    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-model-cache\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:50:46.227794 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.227653    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/901fff62-853f-483f-8c52-e9c76d420b71-dshm\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:50:46.227794 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.227662    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/901fff62-853f-483f-8c52-e9c76d420b71-tls-certs\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:50:46.280164 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:46.280099    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="901fff62-853f-483f-8c52-e9c76d420b71" path="/var/lib/kubelet/pods/901fff62-853f-483f-8c52-e9c76d420b71/volumes"
Jul 27 21:50:53.606440 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.606397    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"]
Jul 27 21:50:53.607061 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.607045    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901fff62-853f-483f-8c52-e9c76d420b71" containerName="main"
Jul 27 21:50:53.607106 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.607063    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="901fff62-853f-483f-8c52-e9c76d420b71" containerName="main"
Jul 27 21:50:53.607190 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.607179    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="901fff62-853f-483f-8c52-e9c76d420b71" containerName="main"
Jul 27 21:50:53.610707 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.610688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:53.613714 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.613690    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-262475-serving-cert\""
Jul 27 21:50:53.625958 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.625925    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"]
Jul 27 21:50:53.696988 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.696923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6skgf\" (UniqueName: \"kubernetes.io/projected/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-kube-api-access-6skgf\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:53.696988 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.696984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:53.697266 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.697014    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:53.797628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.797591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:53.797628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.797628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:53.797897 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.797706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6skgf\" (UniqueName: \"kubernetes.io/projected/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-kube-api-access-6skgf\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:53.797897 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:50:53.797807    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-serving-cert: secret "maas-api-e2e-ipp-a-262475-serving-cert" not found
Jul 27 21:50:53.797897 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:50:53.797895    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls podName:ed4f176a-2a35-43cd-ab68-cd11ed33e4c3 nodeName:}" failed. No retries permitted until 2026-07-27 21:50:54.297874306 +0000 UTC m=+3198.563588406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls") pod "maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw" (UID: "ed4f176a-2a35-43cd-ab68-cd11ed33e4c3") : secret "maas-api-e2e-ipp-a-262475-serving-cert" not found
Jul 27 21:50:53.798370 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.798348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:53.812516 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:53.812488    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6skgf\" (UniqueName: \"kubernetes.io/projected/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-kube-api-access-6skgf\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:54.302342 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.302305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:54.304864 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.304843    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:54.472944 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.472907    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"]
Jul 27 21:50:54.476713 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.476698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:54.479326 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.479304    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-262475\""
Jul 27 21:50:54.488404 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.488373    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"]
Jul 27 21:50:54.504256 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.504198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034cf15a-322c-4550-b2ce-35be02b8aaa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg\" (UID: \"034cf15a-322c-4550-b2ce-35be02b8aaa6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:54.504402 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.504323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hm97\" (UniqueName: \"kubernetes.io/projected/034cf15a-322c-4550-b2ce-35be02b8aaa6-kube-api-access-7hm97\") pod \"payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg\" (UID: \"034cf15a-322c-4550-b2ce-35be02b8aaa6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:54.506383 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.506359    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"]
Jul 27 21:50:54.510835 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.510818    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:54.513788 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.513771    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-262475-dockercfg-kjdcw\""
Jul 27 21:50:54.520893 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.520875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:54.521275 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.521255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"]
Jul 27 21:50:54.605623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.605524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzzmh\" (UniqueName: \"kubernetes.io/projected/41b91cda-91ea-47ab-819c-6e2b9412fce1-kube-api-access-fzzmh\") pod \"payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb\" (UID: \"41b91cda-91ea-47ab-819c-6e2b9412fce1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:54.605623 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.605598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034cf15a-322c-4550-b2ce-35be02b8aaa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg\" (UID: \"034cf15a-322c-4550-b2ce-35be02b8aaa6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:54.605894 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.605641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b91cda-91ea-47ab-819c-6e2b9412fce1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb\" (UID: \"41b91cda-91ea-47ab-819c-6e2b9412fce1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:54.605894 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.605701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hm97\" (UniqueName: \"kubernetes.io/projected/034cf15a-322c-4550-b2ce-35be02b8aaa6-kube-api-access-7hm97\") pod \"payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg\" (UID: \"034cf15a-322c-4550-b2ce-35be02b8aaa6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:54.606905 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.606875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034cf15a-322c-4550-b2ce-35be02b8aaa6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg\" (UID: \"034cf15a-322c-4550-b2ce-35be02b8aaa6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:54.615666 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.615634    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hm97\" (UniqueName: \"kubernetes.io/projected/034cf15a-322c-4550-b2ce-35be02b8aaa6-kube-api-access-7hm97\") pod \"payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg\" (UID: \"034cf15a-322c-4550-b2ce-35be02b8aaa6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:54.679160 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.679134    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"]
Jul 27 21:50:54.681394 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:50:54.681369    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4f176a_2a35_43cd_ab68_cd11ed33e4c3.slice/crio-426e8437ac48444a0451638b5610c9e6dedb653a05a7ecd426e4fc512633296e WatchSource:0}: Error finding container 426e8437ac48444a0451638b5610c9e6dedb653a05a7ecd426e4fc512633296e: Status 404 returned error can't find the container with id 426e8437ac48444a0451638b5610c9e6dedb653a05a7ecd426e4fc512633296e
Jul 27 21:50:54.683189 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.683168    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 21:50:54.706428 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.706403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b91cda-91ea-47ab-819c-6e2b9412fce1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb\" (UID: \"41b91cda-91ea-47ab-819c-6e2b9412fce1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:54.706544 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.706509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzzmh\" (UniqueName: \"kubernetes.io/projected/41b91cda-91ea-47ab-819c-6e2b9412fce1-kube-api-access-fzzmh\") pod \"payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb\" (UID: \"41b91cda-91ea-47ab-819c-6e2b9412fce1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:54.707095 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.707070    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b91cda-91ea-47ab-819c-6e2b9412fce1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb\" (UID: \"41b91cda-91ea-47ab-819c-6e2b9412fce1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:54.716511 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.716490    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzzmh\" (UniqueName: \"kubernetes.io/projected/41b91cda-91ea-47ab-819c-6e2b9412fce1-kube-api-access-fzzmh\") pod \"payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb\" (UID: \"41b91cda-91ea-47ab-819c-6e2b9412fce1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:54.789162 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.789131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:54.825609 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.825538    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:54.985735 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:54.985705    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"]
Jul 27 21:50:54.987541 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:50:54.987514    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b91cda_91ea_47ab_819c_6e2b9412fce1.slice/crio-772b4f8246dd63cf9beedcbf8816c4b316e02faf056b919c2e30bc2386556ca4 WatchSource:0}: Error finding container 772b4f8246dd63cf9beedcbf8816c4b316e02faf056b919c2e30bc2386556ca4: Status 404 returned error can't find the container with id 772b4f8246dd63cf9beedcbf8816c4b316e02faf056b919c2e30bc2386556ca4
Jul 27 21:50:55.159559 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:55.159527    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"]
Jul 27 21:50:55.159983 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:50:55.159956    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034cf15a_322c_4550_b2ce_35be02b8aaa6.slice/crio-3d9029511686257a9b194b55f25608567d6216745a541008504a1ef2163c2a9a WatchSource:0}: Error finding container 3d9029511686257a9b194b55f25608567d6216745a541008504a1ef2163c2a9a: Status 404 returned error can't find the container with id 3d9029511686257a9b194b55f25608567d6216745a541008504a1ef2163c2a9a
Jul 27 21:50:55.188006 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:55.187977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg" event={"ID":"034cf15a-322c-4550-b2ce-35be02b8aaa6","Type":"ContainerStarted","Data":"3d9029511686257a9b194b55f25608567d6216745a541008504a1ef2163c2a9a"}
Jul 27 21:50:55.189402 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:55.189371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb" event={"ID":"41b91cda-91ea-47ab-819c-6e2b9412fce1","Type":"ContainerStarted","Data":"9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925"}
Jul 27 21:50:55.189514 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:55.189419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb" event={"ID":"41b91cda-91ea-47ab-819c-6e2b9412fce1","Type":"ContainerStarted","Data":"772b4f8246dd63cf9beedcbf8816c4b316e02faf056b919c2e30bc2386556ca4"}
Jul 27 21:50:55.189595 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:55.189541    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:50:55.190651 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:55.190631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw" event={"ID":"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3","Type":"ContainerStarted","Data":"426e8437ac48444a0451638b5610c9e6dedb653a05a7ecd426e4fc512633296e"}
Jul 27 21:50:55.207368 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:55.207319    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb" podStartSLOduration=1.207301592 podStartE2EDuration="1.207301592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:50:55.205138858 +0000 UTC m=+3199.470852977" watchObservedRunningTime="2026-07-27 21:50:55.207301592 +0000 UTC m=+3199.473015710"
Jul 27 21:50:56.198293 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:56.198243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw" event={"ID":"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3","Type":"ContainerStarted","Data":"1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009"}
Jul 27 21:50:56.198786 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:56.198317    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:50:56.199954 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:56.199921    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg" event={"ID":"034cf15a-322c-4550-b2ce-35be02b8aaa6","Type":"ContainerStarted","Data":"6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f"}
Jul 27 21:50:56.200076 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:56.200066    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:50:56.215689 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:56.215645    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw" podStartSLOduration=2.465048832 podStartE2EDuration="3.215630764s" totalImagesPullingTime="750.581932ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:50:56.213915252 +0000 UTC m=+3200.479629370" watchObservedRunningTime="2026-07-27 21:50:56.215630764 +0000 UTC m=+3200.481344881"
Jul 27 21:50:56.230732 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:50:56.230688    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg" podStartSLOduration=2.230673316 podStartE2EDuration="2.230673316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:50:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:50:56.23060086 +0000 UTC m=+3200.496314984" watchObservedRunningTime="2026-07-27 21:50:56.230673316 +0000 UTC m=+3200.496387433"
Jul 27 21:51:02.211089 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:02.211054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:51:06.202355 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:06.202316    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:51:07.208237 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:07.208189    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:51:13.570788 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.570751    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"]
Jul 27 21:51:13.575944 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.575922    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:13.578552 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.578531    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-c3af52-dockercfg-dnkd2\""
Jul 27 21:51:13.578833 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.578816    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-c3af52\""
Jul 27 21:51:13.587142 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.587114    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"]
Jul 27 21:51:13.694260 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.694193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b2e288e-062f-458d-a46c-24403c66cabb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2\" (UID: \"9b2e288e-062f-458d-a46c-24403c66cabb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:13.694422 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.694341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzdbv\" (UniqueName: \"kubernetes.io/projected/9b2e288e-062f-458d-a46c-24403c66cabb-kube-api-access-jzdbv\") pod \"payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2\" (UID: \"9b2e288e-062f-458d-a46c-24403c66cabb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:13.795553 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.795523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzdbv\" (UniqueName: \"kubernetes.io/projected/9b2e288e-062f-458d-a46c-24403c66cabb-kube-api-access-jzdbv\") pod \"payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2\" (UID: \"9b2e288e-062f-458d-a46c-24403c66cabb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:13.795735 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.795625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b2e288e-062f-458d-a46c-24403c66cabb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2\" (UID: \"9b2e288e-062f-458d-a46c-24403c66cabb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:13.796320 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.796301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b2e288e-062f-458d-a46c-24403c66cabb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2\" (UID: \"9b2e288e-062f-458d-a46c-24403c66cabb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:13.804304 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.804280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzdbv\" (UniqueName: \"kubernetes.io/projected/9b2e288e-062f-458d-a46c-24403c66cabb-kube-api-access-jzdbv\") pod \"payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2\" (UID: \"9b2e288e-062f-458d-a46c-24403c66cabb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:13.889246 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:13.889136    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:14.256338 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:14.256312    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"]
Jul 27 21:51:14.258479 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:51:14.258449    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2e288e_062f_458d_a46c_24403c66cabb.slice/crio-3211589fc60ff1ed96e7a49a5caf4aba1fc7008afa3d934077747354da6e8dff WatchSource:0}: Error finding container 3211589fc60ff1ed96e7a49a5caf4aba1fc7008afa3d934077747354da6e8dff: Status 404 returned error can't find the container with id 3211589fc60ff1ed96e7a49a5caf4aba1fc7008afa3d934077747354da6e8dff
Jul 27 21:51:14.308128 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:14.308087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2" event={"ID":"9b2e288e-062f-458d-a46c-24403c66cabb","Type":"ContainerStarted","Data":"3211589fc60ff1ed96e7a49a5caf4aba1fc7008afa3d934077747354da6e8dff"}
Jul 27 21:51:15.322805 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:15.322770    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2" event={"ID":"9b2e288e-062f-458d-a46c-24403c66cabb","Type":"ContainerStarted","Data":"ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693"}
Jul 27 21:51:15.323203 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:15.322898    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:15.340103 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:15.340053    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2" podStartSLOduration=2.340039279 podStartE2EDuration="2.340039279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:51:15.33923601 +0000 UTC m=+3219.604950121" watchObservedRunningTime="2026-07-27 21:51:15.340039279 +0000 UTC m=+3219.605753396"
Jul 27 21:51:26.330114 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:26.330084    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:51:39.579371 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:39.579325    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-kf4pz_a0665b62-bc6b-499c-82bd-72fc41782826/payload-processing/0.log"
Jul 27 21:51:39.705052 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:51:39.705014    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2_9b2e288e-062f-458d-a46c-24403c66cabb/payload-processing/0.log"
Jul 27 21:52:34.884130 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:52:34.884097    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb_41b91cda-91ea-47ab-819c-6e2b9412fce1/payload-processing/0.log"
Jul 27 21:52:35.018232 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:52:35.018187    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-kf4pz_a0665b62-bc6b-499c-82bd-72fc41782826/payload-processing/0.log"
Jul 27 21:52:35.140340 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:52:35.140269    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2_9b2e288e-062f-458d-a46c-24403c66cabb/payload-processing/0.log"
Jul 27 21:53:40.543919 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.543881    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"]
Jul 27 21:53:40.544554 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.544133    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw" podUID="ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" containerName="maas-api" containerID="cri-o://1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009" gracePeriod=30
Jul 27 21:53:40.602721 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.602689    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"]
Jul 27 21:53:40.602937 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.602906    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb" podUID="41b91cda-91ea-47ab-819c-6e2b9412fce1" containerName="payload-processing" containerID="cri-o://9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925" gracePeriod=30
Jul 27 21:53:40.610906 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.610878    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"]
Jul 27 21:53:40.611140 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.611116    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg" podUID="034cf15a-322c-4550-b2ce-35be02b8aaa6" containerName="payload-pre-processing" containerID="cri-o://6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f" gracePeriod=30
Jul 27 21:53:40.909527 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.909500    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:53:40.930976 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.930007    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hm97\" (UniqueName: \"kubernetes.io/projected/034cf15a-322c-4550-b2ce-35be02b8aaa6-kube-api-access-7hm97\") pod \"034cf15a-322c-4550-b2ce-35be02b8aaa6\" (UID: \"034cf15a-322c-4550-b2ce-35be02b8aaa6\") "
Jul 27 21:53:40.930976 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.930091    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034cf15a-322c-4550-b2ce-35be02b8aaa6-plugins-config-volume\") pod \"034cf15a-322c-4550-b2ce-35be02b8aaa6\" (UID: \"034cf15a-322c-4550-b2ce-35be02b8aaa6\") "
Jul 27 21:53:40.932568 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.932261    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/034cf15a-322c-4550-b2ce-35be02b8aaa6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "034cf15a-322c-4550-b2ce-35be02b8aaa6" (UID: "034cf15a-322c-4550-b2ce-35be02b8aaa6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:53:40.936814 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.936784    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034cf15a-322c-4550-b2ce-35be02b8aaa6-kube-api-access-7hm97" (OuterVolumeSpecName: "kube-api-access-7hm97") pod "034cf15a-322c-4550-b2ce-35be02b8aaa6" (UID: "034cf15a-322c-4550-b2ce-35be02b8aaa6"). InnerVolumeSpecName "kube-api-access-7hm97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:53:40.947466 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.947445    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:53:40.950610 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:40.950590    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:53:41.030941 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.030908    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b91cda-91ea-47ab-819c-6e2b9412fce1-plugins-config-volume\") pod \"41b91cda-91ea-47ab-819c-6e2b9412fce1\" (UID: \"41b91cda-91ea-47ab-819c-6e2b9412fce1\") "
Jul 27 21:53:41.031110 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.030957    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzzmh\" (UniqueName: \"kubernetes.io/projected/41b91cda-91ea-47ab-819c-6e2b9412fce1-kube-api-access-fzzmh\") pod \"41b91cda-91ea-47ab-819c-6e2b9412fce1\" (UID: \"41b91cda-91ea-47ab-819c-6e2b9412fce1\") "
Jul 27 21:53:41.031110 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.031014    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls\") pod \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") "
Jul 27 21:53:41.031110 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.031076    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-openshift-service-ca\") pod \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") "
Jul 27 21:53:41.031110 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.031108    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6skgf\" (UniqueName: \"kubernetes.io/projected/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-kube-api-access-6skgf\") pod \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\" (UID: \"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3\") "
Jul 27 21:53:41.031459 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.031435    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hm97\" (UniqueName: \"kubernetes.io/projected/034cf15a-322c-4550-b2ce-35be02b8aaa6-kube-api-access-7hm97\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:53:41.031607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.031463    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/034cf15a-322c-4550-b2ce-35be02b8aaa6-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:53:41.031607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.031507    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" (UID: "ed4f176a-2a35-43cd-ab68-cd11ed33e4c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:53:41.031729 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.031675    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41b91cda-91ea-47ab-819c-6e2b9412fce1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41b91cda-91ea-47ab-819c-6e2b9412fce1" (UID: "41b91cda-91ea-47ab-819c-6e2b9412fce1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:53:41.033534 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.033503    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" (UID: "ed4f176a-2a35-43cd-ab68-cd11ed33e4c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:53:41.034071 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.034041    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-kube-api-access-6skgf" (OuterVolumeSpecName: "kube-api-access-6skgf") pod "ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" (UID: "ed4f176a-2a35-43cd-ab68-cd11ed33e4c3"). InnerVolumeSpecName "kube-api-access-6skgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:53:41.034174 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.034075    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b91cda-91ea-47ab-819c-6e2b9412fce1-kube-api-access-fzzmh" (OuterVolumeSpecName: "kube-api-access-fzzmh") pod "41b91cda-91ea-47ab-819c-6e2b9412fce1" (UID: "41b91cda-91ea-47ab-819c-6e2b9412fce1"). InnerVolumeSpecName "kube-api-access-fzzmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:53:41.132912 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.132838    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:53:41.132912 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.132866    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6skgf\" (UniqueName: \"kubernetes.io/projected/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-kube-api-access-6skgf\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:53:41.132912 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.132877    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41b91cda-91ea-47ab-819c-6e2b9412fce1-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:53:41.132912 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.132885    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzzmh\" (UniqueName: \"kubernetes.io/projected/41b91cda-91ea-47ab-819c-6e2b9412fce1-kube-api-access-fzzmh\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:53:41.132912 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.132895    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:53:41.142368 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.142337    2575 generic.go:356] "Generic (PLEG): container finished" podID="41b91cda-91ea-47ab-819c-6e2b9412fce1" containerID="9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925" exitCode=0
Jul 27 21:53:41.142533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.142392    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"
Jul 27 21:53:41.142533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.142419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb" event={"ID":"41b91cda-91ea-47ab-819c-6e2b9412fce1","Type":"ContainerDied","Data":"9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925"}
Jul 27 21:53:41.142533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.142480    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb" event={"ID":"41b91cda-91ea-47ab-819c-6e2b9412fce1","Type":"ContainerDied","Data":"772b4f8246dd63cf9beedcbf8816c4b316e02faf056b919c2e30bc2386556ca4"}
Jul 27 21:53:41.142533 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.142511    2575 scope.go:117] "RemoveContainer" containerID="9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925"
Jul 27 21:53:41.143762 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.143733    2575 generic.go:356] "Generic (PLEG): container finished" podID="ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" containerID="1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009" exitCode=0
Jul 27 21:53:41.143904 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.143774    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"
Jul 27 21:53:41.143904 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.143818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw" event={"ID":"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3","Type":"ContainerDied","Data":"1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009"}
Jul 27 21:53:41.143904 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.143866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw" event={"ID":"ed4f176a-2a35-43cd-ab68-cd11ed33e4c3","Type":"ContainerDied","Data":"426e8437ac48444a0451638b5610c9e6dedb653a05a7ecd426e4fc512633296e"}
Jul 27 21:53:41.145666 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.145642    2575 generic.go:356] "Generic (PLEG): container finished" podID="034cf15a-322c-4550-b2ce-35be02b8aaa6" containerID="6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f" exitCode=0
Jul 27 21:53:41.145782 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.145685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg" event={"ID":"034cf15a-322c-4550-b2ce-35be02b8aaa6","Type":"ContainerDied","Data":"6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f"}
Jul 27 21:53:41.148620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.146052    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg" event={"ID":"034cf15a-322c-4550-b2ce-35be02b8aaa6","Type":"ContainerDied","Data":"3d9029511686257a9b194b55f25608567d6216745a541008504a1ef2163c2a9a"}
Jul 27 21:53:41.148620 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.146161    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"
Jul 27 21:53:41.163782 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.163763    2575 scope.go:117] "RemoveContainer" containerID="9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925"
Jul 27 21:53:41.164086 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:53:41.164064    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925\": container with ID starting with 9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925 not found: ID does not exist" containerID="9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925"
Jul 27 21:53:41.164144 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.164093    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925"} err="failed to get container status \"9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925\": rpc error: code = NotFound desc = could not find container \"9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925\": container with ID starting with 9d73f60e7c2e577df559a992ff9ec5d20e45017fb2a6c92e403832313aef8925 not found: ID does not exist"
Jul 27 21:53:41.164144 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.164117    2575 scope.go:117] "RemoveContainer" containerID="1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009"
Jul 27 21:53:41.172940 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.172920    2575 scope.go:117] "RemoveContainer" containerID="1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009"
Jul 27 21:53:41.173236 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:53:41.173196    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009\": container with ID starting with 1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009 not found: ID does not exist" containerID="1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009"
Jul 27 21:53:41.173330 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.173245    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009"} err="failed to get container status \"1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009\": rpc error: code = NotFound desc = could not find container \"1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009\": container with ID starting with 1d6c123e24b11c672b03da9f599029005b7c0d4b88de5da16bac6c4c3960e009 not found: ID does not exist"
Jul 27 21:53:41.173330 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.173263    2575 scope.go:117] "RemoveContainer" containerID="6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f"
Jul 27 21:53:41.174472 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.174441    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"]
Jul 27 21:53:41.181436 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.181420    2575 scope.go:117] "RemoveContainer" containerID="6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f"
Jul 27 21:53:41.181703 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:53:41.181683    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f\": container with ID starting with 6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f not found: ID does not exist" containerID="6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f"
Jul 27 21:53:41.181792 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.181707    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f"} err="failed to get container status \"6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f\": rpc error: code = NotFound desc = could not find container \"6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f\": container with ID starting with 6b1dd31eaf35c648c8dc03808aa48239b34fba3e4c2a22deb543d5d02668b05f not found: ID does not exist"
Jul 27 21:53:41.185083 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.185062    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-262475-d8d745c86-jwwtb"]
Jul 27 21:53:41.205348 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.205328    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"]
Jul 27 21:53:41.212376 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.212354    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-262475-68457947b4-vrhhg"]
Jul 27 21:53:41.232697 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.232663    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"]
Jul 27 21:53:41.235305 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:41.235284    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-262475-864979f8f7-cb4mw"]
Jul 27 21:53:42.278809 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:42.278772    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="034cf15a-322c-4550-b2ce-35be02b8aaa6" path="/var/lib/kubelet/pods/034cf15a-322c-4550-b2ce-35be02b8aaa6/volumes"
Jul 27 21:53:42.279361 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:42.279337    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41b91cda-91ea-47ab-819c-6e2b9412fce1" path="/var/lib/kubelet/pods/41b91cda-91ea-47ab-819c-6e2b9412fce1/volumes"
Jul 27 21:53:42.279796 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:53:42.279773    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" path="/var/lib/kubelet/pods/ed4f176a-2a35-43cd-ab68-cd11ed33e4c3/volumes"
Jul 27 21:54:47.949740 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:47.949703    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"]
Jul 27 21:54:47.950569 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:47.950536    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2" podUID="9b2e288e-062f-458d-a46c-24403c66cabb" containerName="payload-processing" containerID="cri-o://ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693" gracePeriod=30
Jul 27 21:54:48.230847 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.230821    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:54:48.383875 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.383847    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b2e288e-062f-458d-a46c-24403c66cabb-plugins-config-volume\") pod \"9b2e288e-062f-458d-a46c-24403c66cabb\" (UID: \"9b2e288e-062f-458d-a46c-24403c66cabb\") "
Jul 27 21:54:48.384077 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.383895    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzdbv\" (UniqueName: \"kubernetes.io/projected/9b2e288e-062f-458d-a46c-24403c66cabb-kube-api-access-jzdbv\") pod \"9b2e288e-062f-458d-a46c-24403c66cabb\" (UID: \"9b2e288e-062f-458d-a46c-24403c66cabb\") "
Jul 27 21:54:48.384295 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.384269    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b2e288e-062f-458d-a46c-24403c66cabb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b2e288e-062f-458d-a46c-24403c66cabb" (UID: "9b2e288e-062f-458d-a46c-24403c66cabb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:54:48.386161 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.386125    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b2e288e-062f-458d-a46c-24403c66cabb-kube-api-access-jzdbv" (OuterVolumeSpecName: "kube-api-access-jzdbv") pod "9b2e288e-062f-458d-a46c-24403c66cabb" (UID: "9b2e288e-062f-458d-a46c-24403c66cabb"). InnerVolumeSpecName "kube-api-access-jzdbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:54:48.484662 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.484631    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b2e288e-062f-458d-a46c-24403c66cabb-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:54:48.484809 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.484663    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzdbv\" (UniqueName: \"kubernetes.io/projected/9b2e288e-062f-458d-a46c-24403c66cabb-kube-api-access-jzdbv\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:54:48.519520 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.519486    2575 generic.go:356] "Generic (PLEG): container finished" podID="9b2e288e-062f-458d-a46c-24403c66cabb" containerID="ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693" exitCode=0
Jul 27 21:54:48.519673 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.519539    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"
Jul 27 21:54:48.519673 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.519572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2" event={"ID":"9b2e288e-062f-458d-a46c-24403c66cabb","Type":"ContainerDied","Data":"ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693"}
Jul 27 21:54:48.519673 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.519627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2" event={"ID":"9b2e288e-062f-458d-a46c-24403c66cabb","Type":"ContainerDied","Data":"3211589fc60ff1ed96e7a49a5caf4aba1fc7008afa3d934077747354da6e8dff"}
Jul 27 21:54:48.519673 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.519651    2575 scope.go:117] "RemoveContainer" containerID="ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693"
Jul 27 21:54:48.529597 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.529544    2575 scope.go:117] "RemoveContainer" containerID="ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693"
Jul 27 21:54:48.529875 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:54:48.529855    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693\": container with ID starting with ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693 not found: ID does not exist" containerID="ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693"
Jul 27 21:54:48.529972 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.529884    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693"} err="failed to get container status \"ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693\": rpc error: code = NotFound desc = could not find container \"ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693\": container with ID starting with ab83e7696d5b295468d01a35b6bb0789e12175d993c9d79e0543ef2930331693 not found: ID does not exist"
Jul 27 21:54:48.546708 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.546683    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"]
Jul 27 21:54:48.555562 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:48.555540    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c3af52-7c47c54696-nq7b2"]
Jul 27 21:54:50.278678 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:54:50.278641    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b2e288e-062f-458d-a46c-24403c66cabb" path="/var/lib/kubelet/pods/9b2e288e-062f-458d-a46c-24403c66cabb/volumes"
Jul 27 21:55:08.649851 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:08.649814    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"]
Jul 27 21:55:08.650513 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:08.650123    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d" podUID="42758382-db55-410c-9301-231d7f830496" containerName="maas-api" containerID="cri-o://7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9" gracePeriod=30
Jul 27 21:55:08.715065 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:08.715031    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"]
Jul 27 21:55:08.715345 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:08.715315    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv" podUID="1b70d340-9041-428f-8c0f-2cbb47dfb312" containerName="payload-processing" containerID="cri-o://5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12" gracePeriod=30
Jul 27 21:55:08.721349 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:08.721308    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"]
Jul 27 21:55:08.721818 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:08.721770    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726" podUID="fdaafcc5-be9b-4c08-95d4-600556fd49e6" containerName="payload-pre-processing" containerID="cri-o://d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6" gracePeriod=30
Jul 27 21:55:08.989341 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:08.989315    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:55:09.056627 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.056605    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:55:09.059646 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.059625    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:55:09.085601 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.085569    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls\") pod \"42758382-db55-410c-9301-231d7f830496\" (UID: \"42758382-db55-410c-9301-231d7f830496\") "
Jul 27 21:55:09.085754 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.085705    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnjv2\" (UniqueName: \"kubernetes.io/projected/42758382-db55-410c-9301-231d7f830496-kube-api-access-lnjv2\") pod \"42758382-db55-410c-9301-231d7f830496\" (UID: \"42758382-db55-410c-9301-231d7f830496\") "
Jul 27 21:55:09.085754 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.085740    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42758382-db55-410c-9301-231d7f830496-openshift-service-ca\") pod \"42758382-db55-410c-9301-231d7f830496\" (UID: \"42758382-db55-410c-9301-231d7f830496\") "
Jul 27 21:55:09.086235 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.086166    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42758382-db55-410c-9301-231d7f830496-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "42758382-db55-410c-9301-231d7f830496" (UID: "42758382-db55-410c-9301-231d7f830496"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:09.087777 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.087757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "42758382-db55-410c-9301-231d7f830496" (UID: "42758382-db55-410c-9301-231d7f830496"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:55:09.087867 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.087806    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42758382-db55-410c-9301-231d7f830496-kube-api-access-lnjv2" (OuterVolumeSpecName: "kube-api-access-lnjv2") pod "42758382-db55-410c-9301-231d7f830496" (UID: "42758382-db55-410c-9301-231d7f830496"). InnerVolumeSpecName "kube-api-access-lnjv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:09.187413 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.187384    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b70d340-9041-428f-8c0f-2cbb47dfb312-plugins-config-volume\") pod \"1b70d340-9041-428f-8c0f-2cbb47dfb312\" (UID: \"1b70d340-9041-428f-8c0f-2cbb47dfb312\") "
Jul 27 21:55:09.187612 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.187439    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rjb7\" (UniqueName: \"kubernetes.io/projected/fdaafcc5-be9b-4c08-95d4-600556fd49e6-kube-api-access-2rjb7\") pod \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\" (UID: \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\") "
Jul 27 21:55:09.187612 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.187560    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdaafcc5-be9b-4c08-95d4-600556fd49e6-plugins-config-volume\") pod \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\" (UID: \"fdaafcc5-be9b-4c08-95d4-600556fd49e6\") "
Jul 27 21:55:09.187612 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.187607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzdph\" (UniqueName: \"kubernetes.io/projected/1b70d340-9041-428f-8c0f-2cbb47dfb312-kube-api-access-kzdph\") pod \"1b70d340-9041-428f-8c0f-2cbb47dfb312\" (UID: \"1b70d340-9041-428f-8c0f-2cbb47dfb312\") "
Jul 27 21:55:09.187782 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.187757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b70d340-9041-428f-8c0f-2cbb47dfb312-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b70d340-9041-428f-8c0f-2cbb47dfb312" (UID: "1b70d340-9041-428f-8c0f-2cbb47dfb312"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:09.187958 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.187933    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdaafcc5-be9b-4c08-95d4-600556fd49e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fdaafcc5-be9b-4c08-95d4-600556fd49e6" (UID: "fdaafcc5-be9b-4c08-95d4-600556fd49e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:09.188039 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.188014    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42758382-db55-410c-9301-231d7f830496-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:09.188039 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.188028    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b70d340-9041-428f-8c0f-2cbb47dfb312-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:09.188039 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.188037    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnjv2\" (UniqueName: \"kubernetes.io/projected/42758382-db55-410c-9301-231d7f830496-kube-api-access-lnjv2\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:09.188399 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.188045    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42758382-db55-410c-9301-231d7f830496-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:09.189783 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.189755    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b70d340-9041-428f-8c0f-2cbb47dfb312-kube-api-access-kzdph" (OuterVolumeSpecName: "kube-api-access-kzdph") pod "1b70d340-9041-428f-8c0f-2cbb47dfb312" (UID: "1b70d340-9041-428f-8c0f-2cbb47dfb312"). InnerVolumeSpecName "kube-api-access-kzdph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:09.189928 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.189907    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdaafcc5-be9b-4c08-95d4-600556fd49e6-kube-api-access-2rjb7" (OuterVolumeSpecName: "kube-api-access-2rjb7") pod "fdaafcc5-be9b-4c08-95d4-600556fd49e6" (UID: "fdaafcc5-be9b-4c08-95d4-600556fd49e6"). InnerVolumeSpecName "kube-api-access-2rjb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:09.289294 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.289263    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rjb7\" (UniqueName: \"kubernetes.io/projected/fdaafcc5-be9b-4c08-95d4-600556fd49e6-kube-api-access-2rjb7\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:09.289294 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.289290    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdaafcc5-be9b-4c08-95d4-600556fd49e6-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:09.289294 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.289299    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzdph\" (UniqueName: \"kubernetes.io/projected/1b70d340-9041-428f-8c0f-2cbb47dfb312-kube-api-access-kzdph\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:09.643747 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.643661    2575 generic.go:356] "Generic (PLEG): container finished" podID="42758382-db55-410c-9301-231d7f830496" containerID="7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9" exitCode=0
Jul 27 21:55:09.643747 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.643713    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"
Jul 27 21:55:09.643970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.643752    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d" event={"ID":"42758382-db55-410c-9301-231d7f830496","Type":"ContainerDied","Data":"7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9"}
Jul 27 21:55:09.643970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.643814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d" event={"ID":"42758382-db55-410c-9301-231d7f830496","Type":"ContainerDied","Data":"0d47e7482c2f2fff183907f738b34828e5666d85aa27274fee9e111d6186499e"}
Jul 27 21:55:09.643970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.643847    2575 scope.go:117] "RemoveContainer" containerID="7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9"
Jul 27 21:55:09.645130 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.645109    2575 generic.go:356] "Generic (PLEG): container finished" podID="1b70d340-9041-428f-8c0f-2cbb47dfb312" containerID="5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12" exitCode=0
Jul 27 21:55:09.645202 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.645143    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"
Jul 27 21:55:09.645202 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.645188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv" event={"ID":"1b70d340-9041-428f-8c0f-2cbb47dfb312","Type":"ContainerDied","Data":"5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12"}
Jul 27 21:55:09.645339 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.645258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv" event={"ID":"1b70d340-9041-428f-8c0f-2cbb47dfb312","Type":"ContainerDied","Data":"b8836810a825cf3251fea529b5008e93ca5b30f4868b3829325f072d08aae91d"}
Jul 27 21:55:09.646822 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.646799    2575 generic.go:356] "Generic (PLEG): container finished" podID="fdaafcc5-be9b-4c08-95d4-600556fd49e6" containerID="d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6" exitCode=0
Jul 27 21:55:09.646939 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.646834    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726" event={"ID":"fdaafcc5-be9b-4c08-95d4-600556fd49e6","Type":"ContainerDied","Data":"d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6"}
Jul 27 21:55:09.646939 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.646867    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"
Jul 27 21:55:09.646939 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.646899    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726" event={"ID":"fdaafcc5-be9b-4c08-95d4-600556fd49e6","Type":"ContainerDied","Data":"f7869231631daa34f7eda49918f6344bb3c0fb994fe3b39b8633a4119d7f2edb"}
Jul 27 21:55:09.655492 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.655254    2575 scope.go:117] "RemoveContainer" containerID="7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9"
Jul 27 21:55:09.655755 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:55:09.655535    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9\": container with ID starting with 7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9 not found: ID does not exist" containerID="7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9"
Jul 27 21:55:09.655755 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.655560    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9"} err="failed to get container status \"7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9\": rpc error: code = NotFound desc = could not find container \"7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9\": container with ID starting with 7f14bf3f58fabe240211d19cd6d9b232c13adfb296173c6755571b1209e2acc9 not found: ID does not exist"
Jul 27 21:55:09.655755 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.655575    2575 scope.go:117] "RemoveContainer" containerID="5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12"
Jul 27 21:55:09.664090 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.664067    2575 scope.go:117] "RemoveContainer" containerID="5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12"
Jul 27 21:55:09.664439 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:55:09.664416    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12\": container with ID starting with 5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12 not found: ID does not exist" containerID="5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12"
Jul 27 21:55:09.664518 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.664448    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12"} err="failed to get container status \"5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12\": rpc error: code = NotFound desc = could not find container \"5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12\": container with ID starting with 5ad294d8d5a4f1ff22103feb1efb3feed5175ea9717da0619b7a917989a4bf12 not found: ID does not exist"
Jul 27 21:55:09.664518 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.664472    2575 scope.go:117] "RemoveContainer" containerID="d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6"
Jul 27 21:55:09.678450 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.678423    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"]
Jul 27 21:55:09.681181 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.681165    2575 scope.go:117] "RemoveContainer" containerID="d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6"
Jul 27 21:55:09.681511 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:55:09.681494    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6\": container with ID starting with d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6 not found: ID does not exist" containerID="d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6"
Jul 27 21:55:09.681568 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.681516    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6"} err="failed to get container status \"d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6\": rpc error: code = NotFound desc = could not find container \"d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6\": container with ID starting with d659b4cbdcc3a015d348a48e2ccb448d2ca25c465e398bc5e9271571a9d08af6 not found: ID does not exist"
Jul 27 21:55:09.691390 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.691370    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-3298cd-5b6d8cd5d8-rzf4d"]
Jul 27 21:55:09.722177 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.722152    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"]
Jul 27 21:55:09.726505 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.726479    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-3298cd-786d45cbcd-9qvfv"]
Jul 27 21:55:09.737305 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.737279    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"]
Jul 27 21:55:09.745633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:09.745614    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-3298cd-6d989d897b-b9726"]
Jul 27 21:55:10.278667 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:10.278636    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b70d340-9041-428f-8c0f-2cbb47dfb312" path="/var/lib/kubelet/pods/1b70d340-9041-428f-8c0f-2cbb47dfb312/volumes"
Jul 27 21:55:10.279179 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:10.279156    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42758382-db55-410c-9301-231d7f830496" path="/var/lib/kubelet/pods/42758382-db55-410c-9301-231d7f830496/volumes"
Jul 27 21:55:10.279692 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:10.279670    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdaafcc5-be9b-4c08-95d4-600556fd49e6" path="/var/lib/kubelet/pods/fdaafcc5-be9b-4c08-95d4-600556fd49e6/volumes"
Jul 27 21:55:28.084592 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.084557    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"]
Jul 27 21:55:28.084993 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.084762    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t" podUID="37051792-133c-4efa-af10-8d4bb2d25488" containerName="maas-api" containerID="cri-o://990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b" gracePeriod=30
Jul 27 21:55:28.178665 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.178625    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t" podUID="37051792-133c-4efa-af10-8d4bb2d25488" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.86:8443/health\": dial tcp 10.133.0.86:8443: connect: connection refused"
Jul 27 21:55:28.224351 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.224063    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"]
Jul 27 21:55:28.224624 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.224589    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz" podUID="2e676a7a-5190-47c4-a835-819c38260956" containerName="payload-processing" containerID="cri-o://281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904" gracePeriod=30
Jul 27 21:55:28.247440 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.247412    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"]
Jul 27 21:55:28.247836 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.247792    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57" podUID="22d24984-59b4-47a3-b456-5a3ec4f1818f" containerName="payload-pre-processing" containerID="cri-o://fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77" gracePeriod=30
Jul 27 21:55:28.384846 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.384819    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:55:28.565003 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.564981    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:55:28.565250 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.565192    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k4rg\" (UniqueName: \"kubernetes.io/projected/37051792-133c-4efa-af10-8d4bb2d25488-kube-api-access-8k4rg\") pod \"37051792-133c-4efa-af10-8d4bb2d25488\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") "
Jul 27 21:55:28.565380 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.565345    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls\") pod \"37051792-133c-4efa-af10-8d4bb2d25488\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") "
Jul 27 21:55:28.565453 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.565379    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37051792-133c-4efa-af10-8d4bb2d25488-openshift-service-ca\") pod \"37051792-133c-4efa-af10-8d4bb2d25488\" (UID: \"37051792-133c-4efa-af10-8d4bb2d25488\") "
Jul 27 21:55:28.565752 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.565719    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37051792-133c-4efa-af10-8d4bb2d25488-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37051792-133c-4efa-af10-8d4bb2d25488" (UID: "37051792-133c-4efa-af10-8d4bb2d25488"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:28.567488 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.567467    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37051792-133c-4efa-af10-8d4bb2d25488-kube-api-access-8k4rg" (OuterVolumeSpecName: "kube-api-access-8k4rg") pod "37051792-133c-4efa-af10-8d4bb2d25488" (UID: "37051792-133c-4efa-af10-8d4bb2d25488"). InnerVolumeSpecName "kube-api-access-8k4rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:28.567583 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.567568    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37051792-133c-4efa-af10-8d4bb2d25488" (UID: "37051792-133c-4efa-af10-8d4bb2d25488"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 21:55:28.568586 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.568561    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:55:28.666400 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666312    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22d24984-59b4-47a3-b456-5a3ec4f1818f-plugins-config-volume\") pod \"22d24984-59b4-47a3-b456-5a3ec4f1818f\" (UID: \"22d24984-59b4-47a3-b456-5a3ec4f1818f\") "
Jul 27 21:55:28.666400 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666373    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfh7p\" (UniqueName: \"kubernetes.io/projected/2e676a7a-5190-47c4-a835-819c38260956-kube-api-access-tfh7p\") pod \"2e676a7a-5190-47c4-a835-819c38260956\" (UID: \"2e676a7a-5190-47c4-a835-819c38260956\") "
Jul 27 21:55:28.666602 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666467    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpvt7\" (UniqueName: \"kubernetes.io/projected/22d24984-59b4-47a3-b456-5a3ec4f1818f-kube-api-access-bpvt7\") pod \"22d24984-59b4-47a3-b456-5a3ec4f1818f\" (UID: \"22d24984-59b4-47a3-b456-5a3ec4f1818f\") "
Jul 27 21:55:28.666602 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666526    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e676a7a-5190-47c4-a835-819c38260956-plugins-config-volume\") pod \"2e676a7a-5190-47c4-a835-819c38260956\" (UID: \"2e676a7a-5190-47c4-a835-819c38260956\") "
Jul 27 21:55:28.666761 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666744    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37051792-133c-4efa-af10-8d4bb2d25488-maas-api-tls\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:28.666826 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666764    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37051792-133c-4efa-af10-8d4bb2d25488-openshift-service-ca\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:28.666826 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666774    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k4rg\" (UniqueName: \"kubernetes.io/projected/37051792-133c-4efa-af10-8d4bb2d25488-kube-api-access-8k4rg\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:28.666826 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666804    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22d24984-59b4-47a3-b456-5a3ec4f1818f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "22d24984-59b4-47a3-b456-5a3ec4f1818f" (UID: "22d24984-59b4-47a3-b456-5a3ec4f1818f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:28.666983 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.666939    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e676a7a-5190-47c4-a835-819c38260956-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e676a7a-5190-47c4-a835-819c38260956" (UID: "2e676a7a-5190-47c4-a835-819c38260956"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 21:55:28.668606 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.668587    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e676a7a-5190-47c4-a835-819c38260956-kube-api-access-tfh7p" (OuterVolumeSpecName: "kube-api-access-tfh7p") pod "2e676a7a-5190-47c4-a835-819c38260956" (UID: "2e676a7a-5190-47c4-a835-819c38260956"). InnerVolumeSpecName "kube-api-access-tfh7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:28.668675 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.668661    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22d24984-59b4-47a3-b456-5a3ec4f1818f-kube-api-access-bpvt7" (OuterVolumeSpecName: "kube-api-access-bpvt7") pod "22d24984-59b4-47a3-b456-5a3ec4f1818f" (UID: "22d24984-59b4-47a3-b456-5a3ec4f1818f"). InnerVolumeSpecName "kube-api-access-bpvt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 21:55:28.751803 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.751761    2575 generic.go:356] "Generic (PLEG): container finished" podID="2e676a7a-5190-47c4-a835-819c38260956" containerID="281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904" exitCode=0
Jul 27 21:55:28.751971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.751815    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"
Jul 27 21:55:28.751971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.751842    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz" event={"ID":"2e676a7a-5190-47c4-a835-819c38260956","Type":"ContainerDied","Data":"281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904"}
Jul 27 21:55:28.751971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.751890    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz" event={"ID":"2e676a7a-5190-47c4-a835-819c38260956","Type":"ContainerDied","Data":"4cf16a18f2c247bf83d4c52d59623547756daf064364aea8f7c4d03cae039b1f"}
Jul 27 21:55:28.751971 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.751916    2575 scope.go:117] "RemoveContainer" containerID="281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904"
Jul 27 21:55:28.753389 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.753355    2575 generic.go:356] "Generic (PLEG): container finished" podID="37051792-133c-4efa-af10-8d4bb2d25488" containerID="990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b" exitCode=0
Jul 27 21:55:28.753530 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.753428    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"
Jul 27 21:55:28.753530 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.753429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t" event={"ID":"37051792-133c-4efa-af10-8d4bb2d25488","Type":"ContainerDied","Data":"990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b"}
Jul 27 21:55:28.753530 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.753498    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t" event={"ID":"37051792-133c-4efa-af10-8d4bb2d25488","Type":"ContainerDied","Data":"34855651f1772ed902dd5d3a9e4d33a00b3c123b644c14d8b8cbae02e00c6811"}
Jul 27 21:55:28.754933 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.754879    2575 generic.go:356] "Generic (PLEG): container finished" podID="22d24984-59b4-47a3-b456-5a3ec4f1818f" containerID="fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77" exitCode=0
Jul 27 21:55:28.755035 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.754914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57" event={"ID":"22d24984-59b4-47a3-b456-5a3ec4f1818f","Type":"ContainerDied","Data":"fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77"}
Jul 27 21:55:28.755035 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.754961    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"
Jul 27 21:55:28.755035 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.755005    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57" event={"ID":"22d24984-59b4-47a3-b456-5a3ec4f1818f","Type":"ContainerDied","Data":"ba6ff6338ecbeed30d0ee7fd4995eb962b336ba13470269508ae74a9d8a5b23a"}
Jul 27 21:55:28.762642 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.762622    2575 scope.go:117] "RemoveContainer" containerID="281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904"
Jul 27 21:55:28.762911 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:55:28.762892    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904\": container with ID starting with 281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904 not found: ID does not exist" containerID="281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904"
Jul 27 21:55:28.763000 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.762923    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904"} err="failed to get container status \"281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904\": rpc error: code = NotFound desc = could not find container \"281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904\": container with ID starting with 281fd95b84d623975bf43df4ca3f968077caa6c09cb6b582eaa84cc3574cc904 not found: ID does not exist"
Jul 27 21:55:28.763000 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.762946    2575 scope.go:117] "RemoveContainer" containerID="990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b"
Jul 27 21:55:28.767579 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.767530    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e676a7a-5190-47c4-a835-819c38260956-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:28.767579 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.767548    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22d24984-59b4-47a3-b456-5a3ec4f1818f-plugins-config-volume\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:28.767579 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.767556    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfh7p\" (UniqueName: \"kubernetes.io/projected/2e676a7a-5190-47c4-a835-819c38260956-kube-api-access-tfh7p\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:28.767579 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.767565    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpvt7\" (UniqueName: \"kubernetes.io/projected/22d24984-59b4-47a3-b456-5a3ec4f1818f-kube-api-access-bpvt7\") on node \"ip-10-0-131-197.ec2.internal\" DevicePath \"\""
Jul 27 21:55:28.772613 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.772597    2575 scope.go:117] "RemoveContainer" containerID="990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b"
Jul 27 21:55:28.772868 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:55:28.772849    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b\": container with ID starting with 990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b not found: ID does not exist" containerID="990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b"
Jul 27 21:55:28.772911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.772877    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b"} err="failed to get container status \"990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b\": rpc error: code = NotFound desc = could not find container \"990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b\": container with ID starting with 990184698b5671c36c9d96580466ed2874fef60ce5b31754472d0d4a6dc64e1b not found: ID does not exist"
Jul 27 21:55:28.772911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.772892    2575 scope.go:117] "RemoveContainer" containerID="fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77"
Jul 27 21:55:28.780160 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.780140    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"]
Jul 27 21:55:28.782183 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.782166    2575 scope.go:117] "RemoveContainer" containerID="fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77"
Jul 27 21:55:28.782484 ip-10-0-131-197 kubenswrapper[2575]: E0727 21:55:28.782461    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77\": container with ID starting with fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77 not found: ID does not exist" containerID="fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77"
Jul 27 21:55:28.782554 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.782492    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77"} err="failed to get container status \"fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77\": rpc error: code = NotFound desc = could not find container \"fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77\": container with ID starting with fbfd8b20fabfc69aef9454c129b3ba3680665225726916d9c76a9fd157710a77 not found: ID does not exist"
Jul 27 21:55:28.784077 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.784055    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-2cf6fc-5db6569b58-mhkdz"]
Jul 27 21:55:28.793619 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.793596    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"]
Jul 27 21:55:28.799355 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.799337    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-2cf6fc-dd5f95d44-9wm57"]
Jul 27 21:55:28.809260 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.809198    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"]
Jul 27 21:55:28.813751 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:28.813731    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-2cf6fc-7fbd5c4b9b-kd74t"]
Jul 27 21:55:30.278454 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:30.278421    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22d24984-59b4-47a3-b456-5a3ec4f1818f" path="/var/lib/kubelet/pods/22d24984-59b4-47a3-b456-5a3ec4f1818f/volumes"
Jul 27 21:55:30.278979 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:30.278958    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e676a7a-5190-47c4-a835-819c38260956" path="/var/lib/kubelet/pods/2e676a7a-5190-47c4-a835-819c38260956/volumes"
Jul 27 21:55:30.279408 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:30.279388    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37051792-133c-4efa-af10-8d4bb2d25488" path="/var/lib/kubelet/pods/37051792-133c-4efa-af10-8d4bb2d25488/volumes"
Jul 27 21:55:35.708089 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:35.708058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c88d45cc-x6hkm_9910b9be-246a-4889-9ea4-cca2932ccc25/authorino/0.log"
Jul 27 21:55:41.570258 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:41.570227    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mdz9j_7af33f92-0f45-43a0-adb8-a6c1a758ab00/manager/0.log"
Jul 27 21:55:41.692836 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:41.692805    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ssrdw_04aadbe7-0253-4da0-b92f-4067463a6db0/manager/0.log"
Jul 27 21:55:41.814495 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:41.814461    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6574497c9c-k8njw_434d0e3d-746f-4bab-b492-014c02bc7ce4/manager/0.log"
Jul 27 21:55:41.937821 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:41.937737    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ltsvn_c6ecb359-1e6b-400c-a8ef-b4d010c57ce7/server/0.log"
Jul 27 21:55:42.063437 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:42.063409    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ztqhj_f6da9e7e-2f57-4baa-a635-2ac347e076f4/manager/0.log"
Jul 27 21:55:42.337335 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:42.337305    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cd98846-lm9cg_28f383a2-7454-46db-bc55-5fce3e7e72cb/copy-manifests/0.log"
Jul 27 21:55:42.345083 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:42.345058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cd98846-lm9cg_28f383a2-7454-46db-bc55-5fce3e7e72cb/manager/0.log"
Jul 27 21:55:42.872200 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:42.872168    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-847d547f49-2mkd7_96bcd295-4cb8-4415-b149-75f41b834f1b/maas-api/0.log"
Jul 27 21:55:43.362123 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:43.362089    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5mfr4_71f0b7ad-712e-4dc1-a060-9fae97f187a9/postgres/0.log"
Jul 27 21:55:44.747368 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:44.747340    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c88d45cc-x6hkm_9910b9be-246a-4889-9ea4-cca2932ccc25/authorino/0.log"
Jul 27 21:55:44.870495 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:44.870468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pmw4d_b0e0749c-172d-4d94-aa67-b4b08b49ff78/manager/0.log"
Jul 27 21:55:44.990325 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:44.990298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wgswk_e596f0dd-90a9-416c-bf4f-3b4e42fc02ad/manager/0.log"
Jul 27 21:55:45.238681 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:45.238659    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v927g_de375f6d-aa8c-4b80-a466-e674b631259c/registry-server/0.log"
Jul 27 21:55:45.618435 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:45.618362    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7mnxg_266ee37d-7ca5-44f1-9232-df8971422f20/manager/0.log"
Jul 27 21:55:45.996711 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:45.996688    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c_78362b9a-ff78-45cd-bd2d-ee45cff8d9a7/istio-proxy/0.log"
Jul 27 21:55:46.257637 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:46.257566    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d89c5fb64-pqfd9_bf96b3ef-887f-4799-80f7-f01b76efd176/kube-auth-proxy/0.log"
Jul 27 21:55:46.497067 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:46.497034    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-phcfn_b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2/istio-proxy/1.log"
Jul 27 21:55:46.623025 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:46.622944    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zt2gn_ea6e2f50-66b2-47ba-8e2b-313f8119dbf8/payload-pre-processing/0.log"
Jul 27 21:55:46.747058 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:46.747023    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-kf4pz_a0665b62-bc6b-499c-82bd-72fc41782826/payload-processing/0.log"
Jul 27 21:55:47.538673 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:47.538639    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9qwct_138a1be2-d6eb-4466-a61a-ab3144668205/main/0.log"
Jul 27 21:55:47.912100 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:47.912025    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-29kpd_e3365a9f-7181-4505-bb3c-9387e7b083d6/main/0.log"
Jul 27 21:55:53.771945 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.771904    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-km5v5/must-gather-v5sdc"]
Jul 27 21:55:53.772465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772445    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e676a7a-5190-47c4-a835-819c38260956" containerName="payload-processing"
Jul 27 21:55:53.772465 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772467    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e676a7a-5190-47c4-a835-819c38260956" containerName="payload-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772478    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b2e288e-062f-458d-a46c-24403c66cabb" containerName="payload-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772513    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b2e288e-062f-458d-a46c-24403c66cabb" containerName="payload-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772521    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37051792-133c-4efa-af10-8d4bb2d25488" containerName="maas-api"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772527    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="37051792-133c-4efa-af10-8d4bb2d25488" containerName="maas-api"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772534    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b91cda-91ea-47ab-819c-6e2b9412fce1" containerName="payload-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772540    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b91cda-91ea-47ab-819c-6e2b9412fce1" containerName="payload-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772562    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42758382-db55-410c-9301-231d7f830496" containerName="maas-api"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772570    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="42758382-db55-410c-9301-231d7f830496" containerName="maas-api"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772582    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22d24984-59b4-47a3-b456-5a3ec4f1818f" containerName="payload-pre-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772588    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="22d24984-59b4-47a3-b456-5a3ec4f1818f" containerName="payload-pre-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772593    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034cf15a-322c-4550-b2ce-35be02b8aaa6" containerName="payload-pre-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772598    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="034cf15a-322c-4550-b2ce-35be02b8aaa6" containerName="payload-pre-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772609    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" containerName="maas-api"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772614    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" containerName="maas-api"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772628    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdaafcc5-be9b-4c08-95d4-600556fd49e6" containerName="payload-pre-processing"
Jul 27 21:55:53.772633 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772637    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdaafcc5-be9b-4c08-95d4-600556fd49e6" containerName="payload-pre-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772659    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b70d340-9041-428f-8c0f-2cbb47dfb312" containerName="payload-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772665    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b70d340-9041-428f-8c0f-2cbb47dfb312" containerName="payload-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772731    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e676a7a-5190-47c4-a835-819c38260956" containerName="payload-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772741    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed4f176a-2a35-43cd-ab68-cd11ed33e4c3" containerName="maas-api"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772748    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="37051792-133c-4efa-af10-8d4bb2d25488" containerName="maas-api"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772754    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b91cda-91ea-47ab-819c-6e2b9412fce1" containerName="payload-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772760    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="22d24984-59b4-47a3-b456-5a3ec4f1818f" containerName="payload-pre-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772767    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="034cf15a-322c-4550-b2ce-35be02b8aaa6" containerName="payload-pre-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772773    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdaafcc5-be9b-4c08-95d4-600556fd49e6" containerName="payload-pre-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772778    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b2e288e-062f-458d-a46c-24403c66cabb" containerName="payload-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772783    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b70d340-9041-428f-8c0f-2cbb47dfb312" containerName="payload-processing"
Jul 27 21:55:53.773173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.772789    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="42758382-db55-410c-9301-231d7f830496" containerName="maas-api"
Jul 27 21:55:53.776120 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.776102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km5v5/must-gather-v5sdc"
Jul 27 21:55:53.778933 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.778905    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-km5v5\"/\"default-dockercfg-fvx26\""
Jul 27 21:55:53.779173 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.779159    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-km5v5\"/\"openshift-service-ca.crt\""
Jul 27 21:55:53.779562 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.779543    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-km5v5\"/\"kube-root-ca.crt\""
Jul 27 21:55:53.789551 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.789524    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km5v5/must-gather-v5sdc"]
Jul 27 21:55:53.874743 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.874711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d-must-gather-output\") pod \"must-gather-v5sdc\" (UID: \"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d\") " pod="openshift-must-gather-km5v5/must-gather-v5sdc"
Jul 27 21:55:53.874743 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.874745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4b4\" (UniqueName: \"kubernetes.io/projected/3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d-kube-api-access-8g4b4\") pod \"must-gather-v5sdc\" (UID: \"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d\") " pod="openshift-must-gather-km5v5/must-gather-v5sdc"
Jul 27 21:55:53.975600 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.975565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d-must-gather-output\") pod \"must-gather-v5sdc\" (UID: \"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d\") " pod="openshift-must-gather-km5v5/must-gather-v5sdc"
Jul 27 21:55:53.975773 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.975609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4b4\" (UniqueName: \"kubernetes.io/projected/3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d-kube-api-access-8g4b4\") pod \"must-gather-v5sdc\" (UID: \"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d\") " pod="openshift-must-gather-km5v5/must-gather-v5sdc"
Jul 27 21:55:53.975913 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.975893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d-must-gather-output\") pod \"must-gather-v5sdc\" (UID: \"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d\") " pod="openshift-must-gather-km5v5/must-gather-v5sdc"
Jul 27 21:55:53.990560 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:53.990536    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4b4\" (UniqueName: \"kubernetes.io/projected/3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d-kube-api-access-8g4b4\") pod \"must-gather-v5sdc\" (UID: \"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d\") " pod="openshift-must-gather-km5v5/must-gather-v5sdc"
Jul 27 21:55:54.085688 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:54.085601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km5v5/must-gather-v5sdc"
Jul 27 21:55:54.226279 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:54.226244    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km5v5/must-gather-v5sdc"]
Jul 27 21:55:54.228674 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:55:54.228639    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c8ff6a3_f4ce_441c_8d9a_acbbe31fc39d.slice/crio-cd8a080eb3d4b585352e91caed40d2766aae7dda1c25d079e882d62b3bd09503 WatchSource:0}: Error finding container cd8a080eb3d4b585352e91caed40d2766aae7dda1c25d079e882d62b3bd09503: Status 404 returned error can't find the container with id cd8a080eb3d4b585352e91caed40d2766aae7dda1c25d079e882d62b3bd09503
Jul 27 21:55:54.893070 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:54.893039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km5v5/must-gather-v5sdc" event={"ID":"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d","Type":"ContainerStarted","Data":"cd8a080eb3d4b585352e91caed40d2766aae7dda1c25d079e882d62b3bd09503"}
Jul 27 21:55:55.900486 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:55.900448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km5v5/must-gather-v5sdc" event={"ID":"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d","Type":"ContainerStarted","Data":"07b6073aaea0901827cabe741865634362b2bba9f98faa162eaffa166c62ec69"}
Jul 27 21:55:55.900880 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:55.900502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km5v5/must-gather-v5sdc" event={"ID":"3c8ff6a3-f4ce-441c-8d9a-acbbe31fc39d","Type":"ContainerStarted","Data":"947d0c3f7be61f88585130763666453287198af22a6ca8fb9916d2ca417ca95e"}
Jul 27 21:55:55.920175 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:55.920110    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-km5v5/must-gather-v5sdc" podStartSLOduration=2.103455025 podStartE2EDuration="2.920090219s" totalImagesPullingTime="816.635194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:55:55.917897093 +0000 UTC m=+3500.183611212" watchObservedRunningTime="2026-07-27 21:55:55.920090219 +0000 UTC m=+3500.185804340"
Jul 27 21:55:56.655727 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:56.655693    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-825k6_5f6948c8-6610-4973-8b75-9ee5f48f8c46/global-pull-secret-syncer/0.log"
Jul 27 21:55:56.853911 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:56.853818    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k2nhq_02bb7ea9-f174-4266-9914-9af66fa50ff4/konnectivity-agent/0.log"
Jul 27 21:55:56.878468 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:55:56.878437    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-197.ec2.internal_856f9094e8566cc5118fb2e7ae028257/haproxy/0.log"
Jul 27 21:56:02.255657 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:02.255583    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c88d45cc-x6hkm_9910b9be-246a-4889-9ea4-cca2932ccc25/authorino/0.log"
Jul 27 21:56:02.284024 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:02.283994    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pmw4d_b0e0749c-172d-4d94-aa67-b4b08b49ff78/manager/0.log"
Jul 27 21:56:02.318686 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:02.318659    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wgswk_e596f0dd-90a9-416c-bf4f-3b4e42fc02ad/manager/0.log"
Jul 27 21:56:02.401003 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:02.400968    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v927g_de375f6d-aa8c-4b80-a466-e674b631259c/registry-server/0.log"
Jul 27 21:56:02.760233 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:02.757726    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7mnxg_266ee37d-7ca5-44f1-9232-df8971422f20/manager/0.log"
Jul 27 21:56:04.778936 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:04.778905    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9x2hq_d39b1fca-da44-4630-855e-078d40794641/node-exporter/0.log"
Jul 27 21:56:04.801433 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:04.801410    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9x2hq_d39b1fca-da44-4630-855e-078d40794641/kube-rbac-proxy/0.log"
Jul 27 21:56:04.825366 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:04.825270    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9x2hq_d39b1fca-da44-4630-855e-078d40794641/init-textfile/0.log"
Jul 27 21:56:05.322943 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:05.322900    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-c5xrb_5b407d69-31e6-4a21-9d48-2062496802a6/prometheus-operator-admission-webhook/0.log"
Jul 27 21:56:06.706759 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.706720    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"]
Jul 27 21:56:06.713379 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.713348    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.726670 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.726641    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"]
Jul 27 21:56:06.817889 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.817839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-podres\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.818092 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.817915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-proc\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.818092 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.818016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zfk\" (UniqueName: \"kubernetes.io/projected/4cc860f8-a4b7-4c29-823d-0ae326a9e900-kube-api-access-79zfk\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.818092 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.818067    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-lib-modules\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.818092 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.818091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-sys\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919316 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-proc\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919507 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919404    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zfk\" (UniqueName: \"kubernetes.io/projected/4cc860f8-a4b7-4c29-823d-0ae326a9e900-kube-api-access-79zfk\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919507 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919413    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-proc\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919507 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-lib-modules\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919507 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-sys\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919692 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-lib-modules\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919692 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-podres\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919692 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919642    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-sys\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.919692 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.919686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cc860f8-a4b7-4c29-823d-0ae326a9e900-podres\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:06.930659 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:06.930629    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zfk\" (UniqueName: \"kubernetes.io/projected/4cc860f8-a4b7-4c29-823d-0ae326a9e900-kube-api-access-79zfk\") pod \"perf-node-gather-daemonset-qg75d\" (UID: \"4cc860f8-a4b7-4c29-823d-0ae326a9e900\") " pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:07.028607 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:07.028571    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:07.261641 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:07.261605    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"]
Jul 27 21:56:07.265316 ip-10-0-131-197 kubenswrapper[2575]: W0727 21:56:07.265269    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4cc860f8_a4b7_4c29_823d_0ae326a9e900.slice/crio-74c05e95b759a6759e6e35892073a02fb9dbb28ca3e3acaea3159a95fd8a4b1e WatchSource:0}: Error finding container 74c05e95b759a6759e6e35892073a02fb9dbb28ca3e3acaea3159a95fd8a4b1e: Status 404 returned error can't find the container with id 74c05e95b759a6759e6e35892073a02fb9dbb28ca3e3acaea3159a95fd8a4b1e
Jul 27 21:56:07.924019 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:07.923986    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d875968df-xdwxv_26967ff6-d2d2-445a-80ef-1f851739dc29/console/0.log"
Jul 27 21:56:07.964613 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:07.964587    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-lftcb_423da2d3-f363-4e67-8326-6a07a8ce41f2/download-server/0.log"
Jul 27 21:56:07.989758 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:07.989607    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d" event={"ID":"4cc860f8-a4b7-4c29-823d-0ae326a9e900","Type":"ContainerStarted","Data":"224f68ae4532ba4e8c1c741a5599f264d812ca17e1e64fc9cc0fa2cf663c21ca"}
Jul 27 21:56:07.989758 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:07.989670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d" event={"ID":"4cc860f8-a4b7-4c29-823d-0ae326a9e900","Type":"ContainerStarted","Data":"74c05e95b759a6759e6e35892073a02fb9dbb28ca3e3acaea3159a95fd8a4b1e"}
Jul 27 21:56:08.006754 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:08.006673    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d" podStartSLOduration=2.006650222 podStartE2EDuration="2.006650222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:56:08.006337074 +0000 UTC m=+3512.272051193" watchObservedRunningTime="2026-07-27 21:56:08.006650222 +0000 UTC m=+3512.272364333"
Jul 27 21:56:08.998483 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:08.998448    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:09.555669 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:09.555643    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dc4bz_e2fab966-db3e-4b31-b267-86a540c056d1/dns/0.log"
Jul 27 21:56:09.575525 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:09.575498    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dc4bz_e2fab966-db3e-4b31-b267-86a540c056d1/kube-rbac-proxy/0.log"
Jul 27 21:56:09.737027 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:09.737002    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vwt8s_6bd9c93f-c2b8-4b88-8e7f-6cc8f4d96260/dns-node-resolver/0.log"
Jul 27 21:56:10.257302 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:10.257275    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-dbcbd47d7-6jhxh_220f5a81-a8f0-4581-a3c5-cab8a5480e85/registry/0.log"
Jul 27 21:56:10.306432 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:10.306401    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v7f7j_15c13300-9c10-484f-b56e-e99e18d3d4d8/node-ca/0.log"
Jul 27 21:56:11.230052 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:11.230015    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c_78362b9a-ff78-45cd-bd2d-ee45cff8d9a7/istio-proxy/0.log"
Jul 27 21:56:11.403134 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:11.403105    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d89c5fb64-pqfd9_bf96b3ef-887f-4799-80f7-f01b76efd176/kube-auth-proxy/0.log"
Jul 27 21:56:11.458035 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:11.458002    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-phcfn_b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2/istio-proxy/0.log"
Jul 27 21:56:11.493316 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:11.493284    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-phcfn_b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2/istio-proxy/1.log"
Jul 27 21:56:11.527984 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:11.527956    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zt2gn_ea6e2f50-66b2-47ba-8e2b-313f8119dbf8/payload-pre-processing/0.log"
Jul 27 21:56:11.559983 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:11.559944    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-kf4pz_a0665b62-bc6b-499c-82bd-72fc41782826/payload-processing/0.log"
Jul 27 21:56:12.422484 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:12.422450    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vk6qw_ef009756-bf54-4db9-9643-5d8893ad5662/serve-healthcheck-canary/0.log"
Jul 27 21:56:13.006926 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:13.006901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dkn4_56ea3acb-af3f-4e01-9b2c-4116b20cccfa/kube-rbac-proxy/0.log"
Jul 27 21:56:13.029427 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:13.029399    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dkn4_56ea3acb-af3f-4e01-9b2c-4116b20cccfa/exporter/0.log"
Jul 27 21:56:13.051764 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:13.051720    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dkn4_56ea3acb-af3f-4e01-9b2c-4116b20cccfa/extractor/0.log"
Jul 27 21:56:15.015648 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:15.015615    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-km5v5/perf-node-gather-daemonset-qg75d"
Jul 27 21:56:15.337251 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:15.337123    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mdz9j_7af33f92-0f45-43a0-adb8-a6c1a758ab00/manager/0.log"
Jul 27 21:56:15.613393 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:15.613306    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ssrdw_04aadbe7-0253-4da0-b92f-4067463a6db0/manager/0.log"
Jul 27 21:56:15.827292 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:15.827259    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6574497c9c-k8njw_434d0e3d-746f-4bab-b492-014c02bc7ce4/manager/0.log"
Jul 27 21:56:15.847352 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:15.847314    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ltsvn_c6ecb359-1e6b-400c-a8ef-b4d010c57ce7/server/0.log"
Jul 27 21:56:15.945870 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:15.945769    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ztqhj_f6da9e7e-2f57-4baa-a635-2ac347e076f4/manager/0.log"
Jul 27 21:56:16.020188 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:16.020134    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cd98846-lm9cg_28f383a2-7454-46db-bc55-5fce3e7e72cb/manager/0.log"
Jul 27 21:56:16.042238 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:16.042182    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cd98846-lm9cg_28f383a2-7454-46db-bc55-5fce3e7e72cb/copy-manifests/0.log"
Jul 27 21:56:17.085322 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:17.085291    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c_78362b9a-ff78-45cd-bd2d-ee45cff8d9a7/istio-proxy/0.log"
Jul 27 21:56:17.247124 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:17.247095    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d89c5fb64-pqfd9_bf96b3ef-887f-4799-80f7-f01b76efd176/kube-auth-proxy/0.log"
Jul 27 21:56:17.284610 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:17.284567    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-phcfn_b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2/istio-proxy/0.log"
Jul 27 21:56:17.322693 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:17.322659    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-phcfn_b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2/istio-proxy/1.log"
Jul 27 21:56:17.348454 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:17.348361    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zt2gn_ea6e2f50-66b2-47ba-8e2b-313f8119dbf8/payload-pre-processing/0.log"
Jul 27 21:56:17.371093 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:17.371061    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-kf4pz_a0665b62-bc6b-499c-82bd-72fc41782826/payload-processing/0.log"
Jul 27 21:56:17.627239 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:17.627099    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-krf4j_ef7f0a90-cdf0-4b76-a82c-7c8db64e73f2/openshift-lws-operator/0.log"
Jul 27 21:56:18.809127 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:18.809094    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lsh7c_78362b9a-ff78-45cd-bd2d-ee45cff8d9a7/istio-proxy/0.log"
Jul 27 21:56:18.969055 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:18.969022    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d89c5fb64-pqfd9_bf96b3ef-887f-4799-80f7-f01b76efd176/kube-auth-proxy/0.log"
Jul 27 21:56:19.005699 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:19.005668    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-phcfn_b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2/istio-proxy/0.log"
Jul 27 21:56:19.045804 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:19.045757    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-phcfn_b2bd6da4-d186-40b2-9a33-cdc8ad0c54e2/istio-proxy/1.log"
Jul 27 21:56:19.073018 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:19.072945    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zt2gn_ea6e2f50-66b2-47ba-8e2b-313f8119dbf8/payload-pre-processing/0.log"
Jul 27 21:56:19.091970 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:19.091915    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-kf4pz_a0665b62-bc6b-499c-82bd-72fc41782826/payload-processing/0.log"
Jul 27 21:56:23.906790 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:23.906765    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8zdsh_542936d6-7cd3-409b-b312-7d318043f522/kube-multus/0.log"
Jul 27 21:56:24.104999 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.104976    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvq9q_5c7f9a86-bdee-4f19-b74a-898fe54df0df/kube-multus-additional-cni-plugins/0.log"
Jul 27 21:56:24.142432 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.142406    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvq9q_5c7f9a86-bdee-4f19-b74a-898fe54df0df/egress-router-binary-copy/0.log"
Jul 27 21:56:24.168055 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.167984    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvq9q_5c7f9a86-bdee-4f19-b74a-898fe54df0df/cni-plugins/0.log"
Jul 27 21:56:24.193157 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.193124    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvq9q_5c7f9a86-bdee-4f19-b74a-898fe54df0df/bond-cni-plugin/0.log"
Jul 27 21:56:24.216469 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.216440    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvq9q_5c7f9a86-bdee-4f19-b74a-898fe54df0df/routeoverride-cni/0.log"
Jul 27 21:56:24.239032 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.239009    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvq9q_5c7f9a86-bdee-4f19-b74a-898fe54df0df/whereabouts-cni-bincopy/0.log"
Jul 27 21:56:24.259628 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.259600    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvq9q_5c7f9a86-bdee-4f19-b74a-898fe54df0df/whereabouts-cni/0.log"
Jul 27 21:56:24.678274 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.678246    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mqsw2_2ee7da33-7e2e-4467-b6d6-54f885d4d067/network-metrics-daemon/0.log"
Jul 27 21:56:24.698694 ip-10-0-131-197 kubenswrapper[2575]: I0727 21:56:24.698661    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mqsw2_2ee7da33-7e2e-4467-b6d6-54f885d4d067/kube-rbac-proxy/0.log"